00000001:02000400:3.0F:1787548452.989558:0:2970:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg613-server.virtnet: executing set_hostid 00000001:02000400:3.0:1787548473.736952:0:3190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg613-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787548475.405066:0:3253:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 883 MB/s 00000001:01000000:3.0:1787548475.654617:0:3253:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1219 MB/s 00000001:01000000:3.0:1787548475.904266:0:3253:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6483 MB/s 00000020:02000000:2.0:1787548476.461732:0:3282:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_82_g53f9976 00000400:02000000:1.0F:1787548477.408470:0:3297:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.113@tcp [8/256/0/180] 00008000:02000000:2.0:1787548481.182530:0:3447:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787548560.930862:0:5259:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg613-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787548569.899444:0:5835:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787548569.899452:0:5835:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787548569.899631:0:5835:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007d878479 00000080:02000400:3.0:1787548569.899645:0:5835:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787548569.905693:0:5835:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787548569.905711:0:5835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787548569.905756:0:5835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000f0378f2) 00000020:00000080:3.0:1787548569.905780:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787548569.932762:0:5835:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787548569.933217:0:5835:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787548569.987254:0:5835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787548569.987386:0:5835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787548569.987411:0:5835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787548569.987467:0:5835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787548569.987495:0:5835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787548569.988921:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787548569.988935:0:5835:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787548569.988951:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb7c48919424e4d6 00000020:01000004:2.0:1787548569.988961:0:5835:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787548569.988967:0:5835:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787548569.988973:0:5835:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007d878479 from MGS 00000020:01000004:2.0:1787548569.988978:0:5835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787548569.989009:0:5835:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000093d1f7e1) 00000020:00000080:2.0:1787548569.989023:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787548569.989121:0:5835:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007d878479 from MGS, refs=2 00080000:01000000:2.0:1787548569.989146:0:5835:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787548569.989152:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb7c48919424e4e4 00000100:00100000:2.0:1787548569.989283:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787548569.989431:0:5835:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787548569.989437:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787548569.995104:0:5835:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787548569.995121:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0F:1787548569.997575:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787548569.997818:0:5835:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787548569.997826:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787548569.999596:0:5835:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787548569.999612:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787548570.000784:0:5835:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787548570.000799:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787548570.015987:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548570.015994:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548570.015998:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548570.016961:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548570.016966:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548570.016967:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548570.017603:0:5835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787548570.020215:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787548570.267365:0:5835:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3223 MB/s 00000001:01000000:2.0:1787548570.518452:0:5835:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2303 MB/s 00000001:01000000:3.0:1787548570.768938:0:5835:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 743 MB/s 00000001:01000000:2.0:1787548571.018576:0:5835:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 819 MB/s 00080000:10000000:3.0:1787548571.044794:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1787548571.071532:0:5835:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787548571.071548:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787548571.071550:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787548571.072159:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787548571.072224:0:5835:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787548571.072272:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787548571.072453:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787548571.072476:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787548571.072807:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787548571.072949:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787548571.072955:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:0.0:1787548571.077002:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548571.077063:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787548571.077074:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787548571.079864:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787548571.079879:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787548571.080755:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787548571.080776:0:5835:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.113@tcp' 00000020:01000004:3.0:1787548571.080777:0:5835:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787548571.080820:0:5835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.113@tcp (typ=mgc) 00000020:00000080:3.0:1787548571.080832:0:5835:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.113@tcp (0000000064a29cdd) 00000020:00000080:3.0:1787548571.080848:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787548571.080924:0:5835:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000037d5dc4b@MGC192.168.206.113@tcp: add connection 192.168.206.113@tcp at head 00010000:00010000:3.0:1787548571.081091:0:5835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.113@tcp-0 is initialized 00000040:01000000:3.0:1787548571.081098:0:5835:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.113@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787548571.090330:0:5851:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787548571.090620:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.113@tcp (uuid 3418829f-2e19-44b5-ae62-1256ac42dc62) 00000020:00000080:3.0:1787548571.090641:0:5835:0:(genops.c:1385:class_connect()) connect: client 3418829f-2e19-44b5-ae62-1256ac42dc62, cookie 0xcb7c48919424e4f2 00000100:00080000:3.0:1787548571.090652:0:5835:0:(import.c:510:import_select_connection()) MGC192.168.206.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787548571.090658:0:5835:0:(import.c:624:import_select_connection()) MGC192.168.206.113@tcp: import 0000000037d5dc4b using connection 192.168.206.113@tcp/0@lo 00000100:00100000:3.0:1787548571.090697:0:5835:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007142be96 x1874380431818880/t0(0) o250->MGC192.168.206.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787548571.090720:0:5835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3418829f-2e19-44b5-ae62-1256ac42dc62->MGS 00000020:01000004:3.0:1787548571.090735:0:5835:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787548571.090740:0:5835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787548571.090752:0:5835:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a0caa35d) 00000020:00000080:3.0:1787548571.090764:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1787548571.092377:0:5850:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1787548571.092554:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007142be96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3418829f-2e19-44b5-ae62-1256ac42dc62:3312:1874380431818880:0@lo:250: 00000100:00100000:0.0:1787548571.092625:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548571.092738:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431818880 00000100:00100000:1.0:1787548571.092745:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431818880 00000100:00100000:1.0:1787548571.092799:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548571.092806:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047144154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3312:x1874380431818880:12345-0@lo:250: 00010000:00080000:1.0:1787548571.092840:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3418829f-2e19-44b5-ae62-1256ac42dc62@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:1.0:1787548571.092864:0:5846:0:(genops.c:1385:class_connect()) connect: client 3418829f-2e19-44b5-ae62-1256ac42dc62, cookie 0xcb7c48919424e500 00000100:00080000:1.0:1787548571.092989:0:5846:0:(import.c:65:import_set_state_nolock()) 00000000b61551ad : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787548571.093166:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047144154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+5:3312:x1874380431818880:12345-0@lo:250: Request processed in 359us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548571.093173:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787548571.096339:0:3312:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787548571.096354:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.113@tcp: connect to target with instance 0 00000100:00080000:0.0:1787548571.096363:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787548571.096368:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787548571.096371:0:3312:0:(import.c:65:import_set_state_nolock()) 0000000037d5dc4b MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787548571.096375:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787548571.096383:0:3312:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787548571.096389:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007142be96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3418829f-2e19-44b5-ae62-1256ac42dc62:3312:1874380431818880:0@lo:250: 00000100:00100000:3.0:1787548571.104309:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787548571.104525:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787548571.104532:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787548571.109084:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787548571.109096:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787548571.109452:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787548571.109458:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787548571.111776:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787548571.112429:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787548571.112437:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787548571.119325:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787548571.119342:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787548571.152271:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787548571.153326:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787548571.153336:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787548571.166705:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787548571.166725:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787548571.172944:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787548571.173115:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787548571.173121:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787548571.173826:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787548571.173833:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787548571.176523:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787548571.176696:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787548571.176702:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787548571.178268:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787548571.178278:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787548571.179176:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787548571.179340:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787548571.179345:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787548571.180543:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787548571.180552:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787548571.208080:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787548571.208468:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787548571.208476:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787548571.210311:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787548571.210322:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787548571.211003:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787548571.211011:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787548571.212530:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787548571.212554:0:5835:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787548571.212559:0:5835:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787548571.212680:0:5835:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787548571.212713:0:5835:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.113@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787548571.212718:0:5835:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787548571.212720:0:5835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787548571.212721:0:5835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787548571.212722:0:5835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787548571.212723:0:5835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787548571.212725:0:5835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787548571.212726:0:5835:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787548571.212727:0:5835:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787548571.212729:0:5835:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787548571.212730:0:5835:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787548571.212731:0:5835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787548571.212732:0:5835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787548571.212735:0:5835:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787548571.212737:0:5835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787548571.212739:0:5835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787548571.212740:0:5835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787548571.212741:0:5835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787548571.212742:0:5835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787548571.212743:0:5835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787548571.212744:0:5835:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787548571.212745:0:5835:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787548571.212746:0:5835:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787548571.212747:0:5835:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787548571.212748:0:5835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787548571.212749:0:5835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787548571.212782:0:5835:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787548571.212797:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef72b41c pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431819008:0@lo:253: 00000100:00100000:2.0:1787548571.212876:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548571.213004:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 0000000016ceb0ae going to sleep for 11 seconds 00000100:00100000:1.0:1787548571.213048:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431819008 00000100:00100000:1.0:1787548571.213056:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431819008 00000100:00100000:1.0:1787548571.213089:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548571.213097:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bd0cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+5:5835:x1874380431819008:12345-0@lo:253: 20000000:01000000:1.0:1787548571.213169:0:5849:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787548571.213172:0:5849:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787548571.213618:0:5871:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787548571.213669:0:5849:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787548571.213972:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787548571.214894:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787548571.215100:0:5849:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787548571.215104:0:5849:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787548571.215109:0:5849:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787548571.215112:0:5849:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787548571.215125:0:5849:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787548571.215316:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787548571.215908:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787548571.215927:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787548571.215977:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787548571.216025:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787548571.216059:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787548571.216256:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787548571.216266:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787548571.216313:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787548571.216321:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787548571.216474:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787548571.216483:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787548571.216529:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787548571.216580:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787548571.216612:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787548571.216617:0:5849:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787548571.216630:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787548571.216816:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787548571.216826:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787548571.216859:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787548571.216892:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787548571.216952:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787548571.216964:0:5849:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787548571.217033:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787548571.217041:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787548571.217090:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787548571.217118:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787548571.217456:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787548571.217467:0:5849:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787548571.217554:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787548571.217562:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787548571.217588:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787548571.217616:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787548571.217754:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787548571.217807:0:5849:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787548571.217814:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787548571.218342:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787548571.218651:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787548571.218669:0:5849:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.113@tcp for mdt 20000000:01000000:1.0:1787548571.218671:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.113@tcp (null) (null) (null) 00000040:00080000:1.0:1787548571.218697:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787548571.218703:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787548571.218726:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787548571.218731:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.113@tcp (null) (null) 00000040:00080000:1.0:1787548571.218766:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787548571.218775:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787548571.218809:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787548571.218844:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787548571.218898:0:5849:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787548571.218902:0:5849:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787548571.218907:0:5849:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787548571.218913:0:5849:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787548571.219574:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1787548571.219760:0:5849:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787548571.225865:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787548571.225912:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1787548571.225999:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1787548571.226018:0:5849:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787548571.226020:0:5849:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787548571.226023:0:5849:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787548571.226034:0:5849:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787548571.226037:0:5849:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787548571.226066:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787548571.226068:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787548571.226955:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1787548571.227258:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1787548571.227329:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1787548571.227418:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1787548571.227432:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787548571.227434:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787548571.227976:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787548571.228225:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787548571.228265:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787548571.228296:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787548571.228309:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787548571.228311:0:5849:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1787548571.228317:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787548571.228334:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006243a1ca/0xcb7c48919424e507 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.228362:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006243a1ca/0xcb7c48919424e507 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.228373:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006243a1ca/0xcb7c48919424e507 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.228379:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006243a1ca/0xcb7c48919424e507 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.228385:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006243a1ca/0xcb7c48919424e507 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.228392:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006243a1ca/0xcb7c48919424e507 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.228398:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006243a1ca already unused, calling callback (000000005dc0ebeb) 00010000:00010000:2.0:1787548571.228401:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006243a1ca/0xcb7c48919424e507 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.228407:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006243a1ca/0xcb7c48919424e507 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.228419:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006243a1ca/0xcb7c48919424e507 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.228435:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006243a1ca/0xcb7c48919424e507 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.228441:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006243a1ca/0xcb7c48919424e507 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787548571.228458:0:5849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787548571.445030:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bd0cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+5:5835:x1874380431819008:12345-0@lo:253: Request processed in 231924us (232145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548571.445050:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787548571.445170:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef72b41c pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431819008:0@lo:253: 10000000:01000000:2.0:1787548571.445186:0:5835:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787548571.445191:0:5835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787548571.445193:0:5835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787548571.445194:0:5835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787548571.445195:0:5835:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787548571.445196:0:5835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787548571.445197:0:5835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787548571.445199:0:5835:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787548571.445200:0:5835:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787548571.445201:0:5835:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787548571.445203:0:5835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787548571.445204:0:5835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787548571.445223:0:5835:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007d878479 from lustre-MDT0000 10000000:01000000:2.0:1787548571.445246:0:5835:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787548571.445249:0:5835:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787548571.445253:0:5835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8fec87eab370 10000000:01000000:2.0:1787548571.445257:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787548571.445263:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fec87eab370 from 1 10000000:01000000:2.0:1787548571.445266:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787548571.445297:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.445306:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.445326:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548571.445342:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef72b41c pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431819136:0@lo:101: 00000100:00100000:2.0:1787548571.445386:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548571.445442:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d210296a going to sleep for 11 seconds 00000100:00100000:0.0:1787548571.445525:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431819136 00000100:00100000:0.0:1787548571.445532:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431819136 00000100:00100000:0.0:1787548571.445586:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787548571.445594:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074b7cfd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+5:5835:x1874380431819136:12345-0@lo:101: 00010000:00010000:0.0:1787548571.445605:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548571.445621:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce445f36/0xcb7c48919424e515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e50e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.445641:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce445f36/0xcb7c48919424e515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e50e expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.445650:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce445f36/0xcb7c48919424e515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e50e expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.445669:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce445f36, rc 0) 00000100:00100000:0.0:1787548571.445708:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074b7cfd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+6:5835:x1874380431819136:12345-0@lo:101: Request processed in 115us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548571.445714:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787548571.445846:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef72b41c pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431819136:0@lo:101: 00010000:00010000:3.0:1787548571.445859:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e515 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.445867:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e515 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548571.445912:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a580035 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431819264:0@lo:501: 00000100:00100000:3.0:1787548571.445949:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548571.445980:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2a970bf going to sleep for 11 seconds 00000100:00100000:0.0:1787548571.446032:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431819264 00000100:00100000:0.0:1787548571.446037:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431819264 00000100:00100000:0.0:1787548571.446061:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787548571.446066:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020a41505 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+6:5835:x1874380431819264:12345-0@lo:501: 00000100:00100000:0.0:1787548571.446306:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020a41505 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+6:5835:x1874380431819264:12345-0@lo:501: Request processed in 239us (357us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787548571.446314:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787548571.446392:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a580035 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431819264:0@lo:501: 10000000:01000000:3.0:1787548571.446412:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787548571.446430:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e515 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.446438:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e515 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548571.446445:0:5835:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fec8644c800 10000000:01000000:3.0:1787548571.446449:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787548571.446453:0:5835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8fec8644c800 10000000:01000000:3.0:1787548571.446456:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787548571.446458:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8fec8644c800 from 1 10000000:01000000:3.0:1787548571.446460:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787548571.446477:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: 000000007bf68408/0xcb7c48919424e51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.446485:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: 000000007bf68408/0xcb7c48919424e51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.446492:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: 000000007bf68408/0xcb7c48919424e51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548571.446503:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a580035 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431819392:0@lo:101: 00000100:00100000:3.0:1787548571.446541:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548571.446560:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2a970bf going to sleep for 11 seconds 00000100:00100000:2.0:1787548571.446624:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431819392 00000100:00100000:2.0:1787548571.446628:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431819392 00000100:00100000:2.0:1787548571.446652:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787548571.446671:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f6782ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+6:5835:x1874380431819392:12345-0@lo:101: 00010000:00010000:2.0:1787548571.446679:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548571.446691:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005e261fd1/0xcb7c48919424e523 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e51c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.446706:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005e261fd1/0xcb7c48919424e523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e51c expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.446714:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005e261fd1/0xcb7c48919424e523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e51c expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548571.446721:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005e261fd1, rc 0) 00000100:00100000:2.0:1787548571.446758:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f6782ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+7:5835:x1874380431819392:12345-0@lo:101: Request processed in 90us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548571.446765:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787548571.446896:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a580035 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431819392:0@lo:101: 00010000:00010000:3.0:1787548571.446906:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: 000000007bf68408/0xcb7c48919424e51c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.446921:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: 000000007bf68408/0xcb7c48919424e51c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548571.446936:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787548571.446938:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: 000000007bf68408/0xcb7c48919424e51c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.446943:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: 000000007bf68408/0xcb7c48919424e51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548571.446948:0:5835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787548571.446951:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787548571.446955:0:5835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8fec8644c800 10000000:01000000:3.0:1787548571.446957:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787548571.446959:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787548571.446961:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787548571.446972:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.446977:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.446983:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548571.446992:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a580035 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431819520:0@lo:101: 00000100:00100000:3.0:1787548571.447017:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548571.447037:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2a970bf going to sleep for 11 seconds 00000100:00100000:0.0:1787548571.447102:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431819520 00000100:00100000:0.0:1787548571.447107:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431819520 00000100:00100000:0.0:1787548571.447125:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787548571.447159:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043d96471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+7:5835:x1874380431819520:12345-0@lo:101: 00010000:00010000:0.0:1787548571.447166:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548571.447174:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069cd820d/0xcb7c48919424e531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e52a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.447186:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069cd820d/0xcb7c48919424e531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e52a expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.447200:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069cd820d/0xcb7c48919424e531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e52a expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.447206:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069cd820d, rc 0) 00000100:00100000:0.0:1787548571.447234:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043d96471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+8:5835:x1874380431819520:12345-0@lo:101: Request processed in 77us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548571.447241:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787548571.447320:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a580035 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431819520:0@lo:101: 00010000:00010000:3.0:1787548571.447330:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e531 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.447337:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e531 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548571.447374:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a580035 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431819648:0@lo:501: 00000100:00100000:3.0:1787548571.447399:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548571.447428:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2a970bf going to sleep for 11 seconds 00000100:00100000:2.0:1787548571.447484:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431819648 00000100:00100000:2.0:1787548571.447488:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431819648 00000100:00100000:2.0:1787548571.447523:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787548571.447530:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d4184af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+8:5835:x1874380431819648:12345-0@lo:501: 00000100:00100000:2.0:1787548571.447898:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d4184af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+9:5835:x1874380431819648:12345-0@lo:501: Request processed in 369us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548571.447905:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787548571.448015:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a580035 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431819648:0@lo:501: 00000100:00100000:3.0:1787548571.448046:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a580035 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431819776:0@lo:503: 00000100:00100000:3.0:1787548571.448084:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548571.448398:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2a970bf going to sleep for 11 seconds 00000100:00100000:0.0:1787548571.448432:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431819776 00000100:00100000:0.0:1787548571.448437:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431819776 00000100:00100000:0.0:1787548571.448516:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787548571.448524:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e88196d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+9:5835:x1874380431819776:12345-0@lo:503: 00000100:00100000:0.0:1787548571.448779:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e88196d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+9:5835:x1874380431819776:12345-0@lo:503: Request processed in 256us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548571.448786:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787548571.448869:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a580035 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431819776:0@lo:503: 00000100:00100000:2.0:1787548571.449301:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000039231d8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:5879:1874380431819904:0@lo:502: 00000100:00100000:2.0:1787548571.449339:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548571.449404:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf191715 going to sleep for 11 seconds 00000100:00100000:0.0:1787548571.449441:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431819904 00000100:00100000:0.0:1787548571.449446:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431819904 00000100:00100000:0.0:1787548571.449517:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787548571.449524:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ad60fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+9:5879:x1874380431819904:12345-0@lo:502: 00000100:00100000:0.0:1787548571.449798:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ad60fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+9:5879:x1874380431819904:12345-0@lo:502: Request processed in 274us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548571.449805:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787548571.449888:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000039231d8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:5879:1874380431819904:0@lo:502: 00000020:01000000:3.0:1787548571.449912:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787548571.449922:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548571.449924:0:5879:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787548571.449928:0:5879:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787548571.449931:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787548571.449944:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009871cafa) 00000020:00000080:3.0:1787548571.449958:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787548571.449963:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787548571.450036:0:5879:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787548571.450043:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb7c48919424e53f 00000020:00000080:3.0:1787548571.450292:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787548571.450297:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787548571.450300:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548571.450302:0:5879:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787548571.450311:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787548571.450315:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548571.450316:0:5879:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787548571.450319:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787548571.450332:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000240964df) 00000020:00000080:3.0:1787548571.450342:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787548571.450346:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787548571.450347:0:5879:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787548571.450350:0:5879:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787548571.450355:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787548571.450393:0:5879:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007d878479 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787548571.450405:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000077978284) 00000020:00000080:3.0:1787548571.450412:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787548571.450488:0:5879:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787548571.450494:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb7c48919424e554 00000020:00000080:3.0:1787548571.450593:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787548571.450599:0:5879:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787548571.450603:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcb7c48919424e55b 00080000:01000000:3.0:1787548571.450607:0:5879:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787548571.450610:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb7c48919424e562 00080000:10000000:2.0:1787548571.451360:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1787548571.451569:0:5879:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787548571.455055:0:5879:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787548571.505445:0:5879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787548571.505820:0:5879:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787548571.508164:0:5879:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787548571.508404:0:5879:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787548571.527387:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000006b94947e) 00000020:00000080:2.0:1787548571.527410:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787548571.527471:0:5879:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787548571.527477:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb7c48919424e570 00000020:00000080:2.0:1787548571.532213:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787548571.534826:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787548571.564825:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787548571.592088:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787548571.621395:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787548571.647185:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787548571.679535:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787548571.706893:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcb7c48919424e577 00000020:00000080:0.0:1787548571.707315:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787548571.707330:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787548571.707335:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548571.707337:0:5879:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787548571.707339:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787548571.707345:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548571.707346:0:5879:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787548571.707349:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787548571.707393:0:5879:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787548571.707408:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787548571.707411:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548571.707412:0:5879:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787548571.707415:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787548571.707418:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548571.707419:0:5879:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787548571.707421:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787548571.707423:0:5879:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787548571.707469:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db654f9d pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:5879:1874380431820032:0@lo:502: 00000100:00100000:0.0:1787548571.707553:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548571.707609:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032ca2582 going to sleep for 11 seconds 00000100:00100000:3.0:1787548571.707683:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431820032 00000100:00100000:3.0:1787548571.707691:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431820032 00000100:00100000:3.0:1787548571.707735:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787548571.707745:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3d7da49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+9:5879:x1874380431820032:12345-0@lo:502: 00000100:00100000:3.0:1787548571.708013:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3d7da49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+9:5879:x1874380431820032:12345-0@lo:502: Request processed in 270us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548571.708021:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787548571.708120:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db654f9d pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:5879:1874380431820032:0@lo:502: 00000020:01000000:0.0:1787548571.708171:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787548571.708175:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548571.708177:0:5879:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787548571.708179:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787548571.708311:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787548571.708326:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787548571.708344:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e531 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.708363:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e531 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548571.708371:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fec8644c800 from 1 10000000:01000000:3.0:1787548571.708373:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787548571.708395:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.708401:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.708409:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548571.708420:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b322b78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431820160:0@lo:101: 00000100:00100000:3.0:1787548571.708449:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548571.708467:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b96ff51d going to sleep for 11 seconds 00000100:00100000:0.0:1787548571.708533:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431820160 00000100:00100000:0.0:1787548571.708538:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431820160 00000100:00100000:0.0:1787548571.708565:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787548571.708572:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062f9d397 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+9:5835:x1874380431820160:12345-0@lo:101: 00010000:00010000:0.0:1787548571.708581:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548571.708591:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003fee48d1/0xcb7c48919424e585 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e57e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.708618:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003fee48d1/0xcb7c48919424e585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e57e expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.708626:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003fee48d1/0xcb7c48919424e585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e57e expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.708634:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003fee48d1, rc 0) 00000100:00100000:0.0:1787548571.708664:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062f9d397 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+10:5835:x1874380431820160:12345-0@lo:101: Request processed in 93us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548571.708671:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787548571.708737:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b322b78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431820160:0@lo:101: 00010000:00010000:3.0:1787548571.708748:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e585 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.708755:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e585 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548571.709309:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b322b78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431820288:0@lo:256: 00000100:00100000:3.0:1787548571.709343:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548571.709360:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b96ff51d going to sleep for 11 seconds 00000100:00100000:3.0:1787548571.709381:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431820288 00000100:00100000:3.0:1787548571.709385:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431820288 00000100:00100000:3.0:1787548571.709409:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787548571.709414:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025b37fae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+10:5835:x1874380431820288:12345-0@lo:256: 20000000:01000000:3.0:1787548571.709427:0:5849:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787548571.709432:0:5849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787548571.709485:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025b37fae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+10:5835:x1874380431820288:12345-0@lo:256: Request processed in 71us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548571.709492:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787548571.709533:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b322b78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431820288:0@lo:256: 10000000:01000000:3.0:1787548571.710086:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787548571.710097:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e585 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.710106:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e585 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548571.710113:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fec8644c800 from 1 10000000:01000000:3.0:1787548571.710115:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787548571.710155:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.710162:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.710169:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548571.710181:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b322b78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431820416:0@lo:101: 00000100:00100000:3.0:1787548571.710221:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548571.710237:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b96ff51d going to sleep for 11 seconds 00000100:00100000:3.0:1787548571.710254:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431820416 00000100:00100000:3.0:1787548571.710259:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431820416 00000100:00100000:3.0:1787548571.710278:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787548571.710283:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090bd2ecc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+10:5835:x1874380431820416:12345-0@lo:101: 00010000:00010000:3.0:1787548571.710291:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548571.710301:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000645173e3/0xcb7c48919424e593 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e58c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.710316:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000645173e3/0xcb7c48919424e593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e58c expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.710324:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000645173e3/0xcb7c48919424e593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e58c expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.710331:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000645173e3, rc 0) 00000100:00100000:3.0:1787548571.710356:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090bd2ecc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+11:5835:x1874380431820416:12345-0@lo:101: Request processed in 73us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548571.710361:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787548571.710389:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b322b78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431820416:0@lo:101: 00010000:00010000:3.0:1787548571.710399:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e593 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.710406:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e593 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548571.710441:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b322b78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431820544:0@lo:501: 00000100:00100000:3.0:1787548571.710472:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548571.710482:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b96ff51d going to sleep for 11 seconds 00000100:00100000:3.0:1787548571.710493:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431820544 00000100:00100000:3.0:1787548571.710496:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431820544 00000100:00100000:3.0:1787548571.710526:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787548571.710530:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070848c5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+11:5835:x1874380431820544:12345-0@lo:501: 00000100:00100000:3.0:1787548571.711009:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070848c5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+11:5835:x1874380431820544:12345-0@lo:501: Request processed in 478us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548571.711016:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787548571.711072:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b322b78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431820544:0@lo:501: 00000100:00100000:3.0:1787548571.711097:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b322b78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431820672:0@lo:503: 00000100:00100000:3.0:1787548571.711161:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548571.711174:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b96ff51d going to sleep for 11 seconds 00000100:00100000:3.0:1787548571.711188:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431820672 00000100:00100000:3.0:1787548571.711191:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431820672 00000100:00100000:3.0:1787548571.711210:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787548571.711215:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3b288d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+11:5835:x1874380431820672:12345-0@lo:503: 00000040:00080000:3.0:1787548571.711244:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787548571.711277:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3b288d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+11:5835:x1874380431820672:12345-0@lo:503: Request processed in 62us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548571.711284:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787548571.711319:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b322b78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431820672:0@lo:503: 00000040:00080000:2.0:1787548571.712239:0:5883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787548571.712405:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787548571.712420:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787548571.712441:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e593 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.712451:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e593 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548571.712490:0:5835:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787548571.712493:0:5835:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fec8644c800 10000000:01000000:0.0:1787548571.712495:0:5835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fec8644c800 10000000:01000000:0.0:1787548571.712499:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787548571.712514:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fec8644c800 from 1 10000000:01000000:0.0:1787548571.712517:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787548571.712542:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.712549:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.712572:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548571.712590:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db654f9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431820800:0@lo:101: 00000100:00100000:0.0:1787548571.712633:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548571.712666:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f50322e7 going to sleep for 11 seconds 00000100:00100000:0.0:1787548571.712684:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431820800 00000100:00100000:0.0:1787548571.712689:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431820800 00000100:00100000:0.0:1787548571.712720:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787548571.712727:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000205bf534 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+11:5835:x1874380431820800:12345-0@lo:101: 00010000:00010000:0.0:1787548571.712737:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548571.712747:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b011606/0xcb7c48919424e5a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e59a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.712765:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b011606/0xcb7c48919424e5a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e59a expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.712773:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b011606/0xcb7c48919424e5a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e59a expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.712780:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b011606, rc 0) 00000100:00100000:0.0:1787548571.712812:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000205bf534 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5835:x1874380431820800:12345-0@lo:101: Request processed in 86us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548571.712818:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787548571.712857:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db654f9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431820800:0@lo:101: 00010000:00010000:0.0:1787548571.712869:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e5a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.712887:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e5a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548571.712925:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db654f9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431820928:0@lo:501: 00000100:00100000:0.0:1787548571.712949:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548571.712963:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f50322e7 going to sleep for 11 seconds 00000100:00100000:0.0:1787548571.712977:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431820928 00000100:00100000:0.0:1787548571.712981:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431820928 00000100:00100000:0.0:1787548571.713001:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787548571.713007:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006742812 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5835:x1874380431820928:12345-0@lo:501: 00000100:00100000:0.0:1787548571.713239:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006742812 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5835:x1874380431820928:12345-0@lo:501: Request processed in 233us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548571.713246:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787548571.713278:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db654f9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431820928:0@lo:501: 00000100:00100000:0.0:1787548571.713301:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db654f9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431821056:0@lo:503: 00000100:00100000:0.0:1787548571.713337:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548571.713355:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f50322e7 going to sleep for 11 seconds 00000100:00100000:0.0:1787548571.713369:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431821056 00000100:00100000:0.0:1787548571.713373:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431821056 00000100:00100000:0.0:1787548571.713393:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787548571.713398:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7ab5e76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5835:x1874380431821056:12345-0@lo:503: 00000100:00100000:0.0:1787548571.713693:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7ab5e76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5835:x1874380431821056:12345-0@lo:503: Request processed in 294us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548571.713700:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787548571.713741:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db654f9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431821056:0@lo:503: 00000100:00100000:0.0:1787548571.713905:0:5884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db654f9d pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:5884:1874380431821184:0@lo:502: 00000100:00100000:0.0:1787548571.713938:0:5884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548571.713958:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431821184 00000100:00100000:0.0:1787548571.713962:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431821184 00000100:00100000:0.0:1787548571.713983:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787548571.713988:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1ab276a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5884:x1874380431821184:12345-0@lo:502: 00000100:00100000:0.0:1787548571.714177:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1ab276a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5884:x1874380431821184:12345-0@lo:502: Request processed in 189us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548571.714184:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787548571.714217:0:5884:0:(client.c:2715:ptlrpc_set_wait()) set 00000000609a879f going to sleep for 11 seconds 00000100:00100000:0.0:1787548571.714229:0:5884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db654f9d pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:5884:1874380431821184:0@lo:502: 00000020:01000004:0.0:1787548571.714278:0:5884:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787548571.714301:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d00e9058) 00000020:00000080:0.0:1787548571.714317:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787548571.714376:0:5884:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007d878479 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787548571.714380:0:5884:0:(tgt_mount.c:187:server_put_mount()) put mount 000000007d878479 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787548571.714382:0:5884:0:(obd_mount.c:710:lustre_put_lsi()) put 000000007d878479 4 00010000:00080000:0.0:1787548571.714406:0:5884:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000099d9e224@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.113@tcp at head 00010000:00010000:1.0:1787548571.716738:0:5884:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787548571.716964:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787548571.716999:0:5884:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787548571.717011:0:5884:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcb7c48919424e5af 00000100:00080000:1.0:1787548571.717020:0:5884:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787548571.717025:0:5884:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000099d9e224 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:1.0:1787548571.717071:0:5884:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ebf1dee8 x1874380431821312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787548571.717121:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ebf1dee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874380431821312:0@lo:38: 00000100:00100000:0.0:1787548571.717221:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787548571.717297:0:5884:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787548571.717377:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431821312 00000100:00100000:3.0:1787548571.717385:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431821312 00000100:00100000:3.0:1787548571.717421:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787548571.717427:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db654f9d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874380431821312:12345-0@lo:38: 00000100:00100000:2.0:1787548571.719471:0:5884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b610b7b pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:5884:1874380431821440:0@lo:502: 00000100:00100000:2.0:1787548571.719554:0:5884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548571.719588:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431821440 00000100:00100000:2.0:1787548571.719594:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431821440 00000100:00100000:2.0:1787548571.719631:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787548571.719638:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e638239e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5884:x1874380431821440:12345-0@lo:502: 00000100:00100000:2.0:1787548571.719954:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e638239e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5884:x1874380431821440:12345-0@lo:502: Request processed in 316us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548571.719962:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787548571.720004:0:5884:0:(client.c:2715:ptlrpc_set_wait()) set 00000000953fed72 going to sleep for 11 seconds 00000100:00100000:2.0:1787548571.720022:0:5884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b610b7b pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:5884:1874380431821440:0@lo:502: 00000040:00080000:2.0:1787548571.720046:0:5884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1787548571.720294:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db654f9d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874380431821312:12345-0@lo:38: Request processed in 2865us (3072us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787548571.720304:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1787548571.722574:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787548571.722605:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787548571.723596:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e5a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548571.723612:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e5a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787548571.723678:0:5835:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787548571.723680:0:5835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787548571.723681:0:5835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787548571.723682:0:5835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787548571.723683:0:5835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787548571.723685:0:5835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787548571.723691:0:5835:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787548571.723692:0:5835:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787548571.723693:0:5835:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787548571.723695:0:5835:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787548571.723696:0:5835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787548571.723697:0:5835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787548571.723700:0:5835:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787548571.723702:0:5835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787548571.723704:0:5835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787548571.723705:0:5835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787548571.723705:0:5835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787548571.723706:0:5835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787548571.723707:0:5835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787548571.723708:0:5835:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787548571.723709:0:5835:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787548571.723710:0:5835:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787548571.723711:0:5835:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787548571.723712:0:5835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787548571.723712:0:5835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787548571.723737:0:5835:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787548571.723753:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c375bf6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431821568:0@lo:253: 00000100:00100000:1.0:1787548571.723819:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548571.723852:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f21decdb going to sleep for 11 seconds 00000100:00100000:0.0:1787548571.724110:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787548571.724117:0:3312:0:(import.c:65:import_set_state_nolock()) 0000000099d9e224 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787548571.724121:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787548571.724125:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ebf1dee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874380431821312:0@lo:38: 00000100:00100000:0.0:1787548571.724170:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431821568 00000100:00100000:0.0:1787548571.724176:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431821568 00000100:00100000:0.0:1787548571.724225:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787548571.724232:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000566de0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5835:x1874380431821568:12345-0@lo:253: 20000000:01000000:0.0:1787548571.724268:0:5848:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787548571.724281:0:5848:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787548571.745666:0:5848:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787548571.745683:0:5848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787548571.745779:0:5871:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787548571.745786:0:5871:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787548571.745810:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.745831:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003fee48d1/0xcb7c48919424e585 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e57e expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.745840:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.745883:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003fee48d1/0xcb7c48919424e585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e57e expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.745896:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003fee48d1/0xcb7c48919424e585 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e57e expref: 12 pid: 5846 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548571.745910:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b322b78 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5871:1874380431821696:0@lo:104: 00000100:00100000:3.0:1787548571.745981:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548571.746044:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set 0000000026b9ab1c going to sleep for 11 seconds 00000100:00100000:0.0:1787548571.746117:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431821696 00000100:00100000:0.0:1787548571.746125:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431821696 00000100:00100000:0.0:1787548571.746193:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787548571.746201:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d24cb47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+3:5871:x1874380431821696:12345-0@lo:104: 00010000:00010000:0.0:1787548571.746212:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e585 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.746265:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787548571.746271:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d24cb47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+3:5871:x1874380431821696:12345-0@lo:104: Request processed in 71us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548571.746278:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787548571.746313:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548571.746318:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e585 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.746325:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008adbebea already unused, calling callback (0000000016f61675) 10000000:00010000:0.0:1787548571.746327:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e585 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.746334:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e585 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787548571.746340:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e585 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548571.746361:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787548571.746388:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e585 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.746394:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787548571.746409:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e585 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.746415:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: 000000008adbebea/0xcb7c48919424e57e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e585 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.746431:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548571.746432:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548571.746433:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548571.746455:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b322b78 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5871:1874380431821696:0@lo:104: 00010000:00010000:0.0:1787548571.746470:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548571.748087:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001599c036 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431821824:0@lo:103: 00000100:00100000:1.0:1787548571.748173:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548571.748393:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431821824 00000100:00100000:3.0:1787548571.748401:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431821824 00010000:00010000:3.0:1787548571.748426:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003fee48d1/0xcb7c48919424e585 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e57e expref: 13 pid: 5846 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548571.748463:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787548571.748471:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004785d4ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+13:3314:x1874380431821824:12345-0@lo:103: 00010000:00010000:3.0:1787548571.748492:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548571.748497:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003fee48d1/0xcb7c48919424e585 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e57e expref: 13 pid: 5846 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.748518:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003fee48d1/0xcb7c48919424e585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e57e expref: 13 pid: 5846 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.748534:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003fee48d1/0xcb7c48919424e585 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e57e expref: 13 pid: 5846 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.748549:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.748556:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787548571.748570:0:5839:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002785339s 00010000:00010000:3.0:1787548571.748573:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.748579:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.748584:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.748589:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.748595:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007b2f1ca6 already unused, calling callback (000000005dc0ebeb) 00010000:00010000:3.0:1787548571.748598:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.748610:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.748625:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548571.748635:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548571.748682:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004785d4ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:3314:x1874380431821824:12345-0@lo:103: Request processed in 212us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548571.748690:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548571.748863:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001599c036 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431821824:0@lo:103: 00010000:00010000:0.0:1787548571.749826:0:5871:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.749839:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548571.749845:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007b2f1ca6/0xcb7c48919424e5b6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548571.753573:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000566de0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+11:5835:x1874380431821568:12345-0@lo:253: Request processed in 29334us (29747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548571.753588:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787548571.753693:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c375bf6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:5835:1874380431821568:0@lo:253: 10000000:01000000:3.0:1787548571.753707:0:5835:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787548571.753710:0:5835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787548571.753712:0:5835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787548571.753713:0:5835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787548571.753714:0:5835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787548571.753715:0:5835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787548571.753717:0:5835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787548571.753718:0:5835:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787548571.753719:0:5835:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787548571.753721:0:5835:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787548571.753722:0:5835:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787548571.753723:0:5835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787548571.753725:0:5835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787548571.753737:0:5835:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787548571.759631:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548571.760074:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787548571.760308:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548571.760485:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787548571.760843:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548571.761039:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787548571.761771:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548571.761957:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787548571.762467:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548571.762746:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787548571.762943:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548571.763116:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787548571.792213:0:5835:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787548571.820252:0:5835:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787548571.820541:0:5890:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787548571.823732:0:5835:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787548571.823969:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1787548571.824358:0:5889:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787548571.824363:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:1.0:1787548571.824597:0:5835:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787548571.824606:0:5835:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787548571.824827:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787548571.825903:0:5835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787548571.826461:0:5835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787548571.826487:0:5835:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787548571.833593:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787548571.840001:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787548571.845940:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787548571.846084:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787548571.846541:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787548571.846769:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787548571.846919:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787548571.847057:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787548571.847218:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787548571.847357:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787548571.847484:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787548571.847648:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787548571.848221:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787548571.848390:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787548571.848550:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787548571.853017:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787548571.853261:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787548571.853440:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787548571.855690:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787548571.855882:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787548571.856049:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787548571.856232:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787548571.856367:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787548571.856540:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787548571.856684:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787548571.856831:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787548571.856961:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787548571.857109:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787548571.857297:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787548571.857445:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787548571.857600:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787548571.857748:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787548571.857900:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787548571.858055:0:5835:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787548571.858276:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1787548571.877782:0:5890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1787548571.940826:0:5835:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787548571.940891:0:5835:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb77041d7b988 00100000:10000000:0.0:1787548571.940909:0:5835:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787548571.941945:0:5835:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787548571.941962:0:5835:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787548571.941976:0:5835:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787548571.942001:0:5835:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787548571.993687:0:5890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787548571.993764:0:5890:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787548571.993769:0:5890:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787548572.099705:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548573.124085:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548574.151751:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548575.172274:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787548575.846272:0:6132:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg613-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787548576.202151:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787548576.775361:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787548576.775371:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787548576.775374:0:38:0:(import.c:65:import_set_state_nolock()) 0000000099d9e224 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787548576.775390:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000099d9e224 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:1.0:1787548576.775432:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005994f972 x1874380431822080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787548576.775527:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787548576.775540:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d54ae6a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431821952:0@lo:400: 00000100:00100000:1.0:1787548576.775602:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548576.775776:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431821952 00000100:00100000:2.0:1787548576.775784:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431821952 00000100:00100000:2.0:1787548576.775829:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787548576.775837:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000191ecfbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+11:3316:x1874380431821952:12345-0@lo:400: 00000100:00100000:2.0:1787548576.775897:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000191ecfbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+11:3316:x1874380431821952:12345-0@lo:400: Request processed in 61us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548576.775904:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787548576.775975:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d54ae6a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431821952:0@lo:400: 00000100:00100000:0.0:1787548576.778051:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005994f972 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874380431822080:0@lo:38: 00000100:00100000:0.0:1787548576.778109:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548576.779044:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431822080 00000100:00100000:1.0:1787548576.779052:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431822080 00000100:00100000:1.0:1787548576.779088:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548576.779101:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d5ee75c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1874380431822080:12345-0@lo:38: 00010000:00080000:1.0:1787548576.779125:0:5856:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1787548576.779292:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcb7c48919424e5bd 00000004:00100000:1.0:1787548576.779327:0:5856:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787548576.779421:0:5856:0:(import.c:65:import_set_state_nolock()) 00000000b13926c6 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787548576.779497:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d5ee75c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874380431822080:12345-0@lo:38: Request processed in 395us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548576.779505:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787548576.779618:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005994f972 x1874380431822080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787548586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787548576.779634:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787548576.779641:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787548576.779645:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787548576.779648:0:3312:0:(import.c:65:import_set_state_nolock()) 0000000099d9e224 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787548576.779653:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005994f972 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874380431822080:0@lo:38: 00010000:00010000:2.0:1787548577.223155:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787548577.286944:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787548577.286950:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fec8644c800 from 3 10000000:01000000:2.0:1787548577.286954:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787548577.286993:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: 000000005b3acc2a/0xcb7c48919424e5c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548577.287004:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: 000000005b3acc2a/0xcb7c48919424e5c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548577.287027:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: 000000005b3acc2a/0xcb7c48919424e5c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548577.287048:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b610b7b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431822208:0@lo:101: 00000100:00100000:2.0:1787548577.287113:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548577.287182:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 000000000dce874e going to sleep for 11 seconds 00000100:00100000:0.0:1787548577.290318:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431822208 00000100:00100000:0.0:1787548577.290333:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431822208 00000100:00100000:0.0:1787548577.290440:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787548577.290451:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c9e934c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+11:5851:x1874380431822208:12345-0@lo:101: 00010000:00010000:0.0:1787548577.290468:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548577.290495:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ecfcabee/0xcb7c48919424e5cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e5c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548577.290520:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ecfcabee/0xcb7c48919424e5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e5c4 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548577.290530:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ecfcabee/0xcb7c48919424e5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e5c4 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548577.290558:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ecfcabee, rc 0) 00000100:00100000:0.0:1787548577.290642:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c9e934c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5851:x1874380431822208:12345-0@lo:101: Request processed in 193us (3530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548577.290649:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787548577.304120:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b610b7b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431822208:0@lo:101: 00010000:00010000:3.0:1787548577.304160:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: 000000005b3acc2a/0xcb7c48919424e5c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e5cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548577.304172:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: 000000005b3acc2a/0xcb7c48919424e5c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e5cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548577.304230:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000324ae0e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431822336:0@lo:256: 00000100:00100000:3.0:1787548577.304290:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548577.304333:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c6b25579 going to sleep for 11 seconds 00000100:00100000:3.0:1787548577.304353:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431822336 00000100:00100000:3.0:1787548577.304359:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431822336 00000100:00100000:3.0:1787548577.304398:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787548577.304406:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067b4080e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5851:x1874380431822336:12345-0@lo:256: 20000000:01000000:3.0:1787548577.304423:0:5846:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787548577.304441:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787548577.304444:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787548577.304534:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067b4080e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5851:x1874380431822336:12345-0@lo:256: Request processed in 129us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548577.304542:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787548577.304578:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000324ae0e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431822336:0@lo:256: 10000000:01000000:3.0:1787548577.304612:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787548577.304618:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: 000000005b3acc2a/0xcb7c48919424e5c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e5cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548577.304625:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: 000000005b3acc2a/0xcb7c48919424e5c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e5cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548578.243360:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548579.277023:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787548580.093123:0:6334:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8c653860 20000000:00000080:3.0:1787548580.093259:0:6334:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fec900b8c00 uarg=0000000000000000 20000000:01000000:3.0:1787548580.093289:0:6334:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787548580.093295:0:6334:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787548580.093300:0:6334:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787548580.093553:0:6334:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787548580.093564:0:6334:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787548580.097021:0:6334:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787548580.097461:0:6334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787548580.097533:0:6334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787548580.097585:0:6334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787548580.097603:0:6334:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787548580.097619:0:6334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548580.097637:0:6334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000645173e3/0xcb7c48919424e593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e58c expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548580.098842:0:6334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548580.098889:0:6334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000645173e3/0xcb7c48919424e593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e58c expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548580.098905:0:6334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000645173e3/0xcb7c48919424e593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e58c expref: 11 pid: 5849 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548580.098918:0:6334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000324ae0e2 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6334:1874380431822464:0@lo:104: 00000100:00100000:3.0:1787548580.098977:0:6334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548580.099026:0:6334:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb2a4020 going to sleep for 11 seconds 00000100:00100000:1.0:1787548580.099147:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431822464 00000100:00100000:1.0:1787548580.099156:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431822464 00000100:00100000:1.0:1787548580.099202:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548580.099210:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003de0a426 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:6334:x1874380431822464:12345-0@lo:104: 00010000:00010000:1.0:1787548580.099221:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e593 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099300:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787548580.099306:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003de0a426 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:6334:x1874380431822464:12345-0@lo:104: Request processed in 97us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548580.099313:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787548580.099334:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548580.099339:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e593 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099346:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006a40b6e1 already unused, calling callback (0000000016f61675) 10000000:00010000:1.0:1787548580.099349:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e593 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099370:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e593 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548580.099385:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e593 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548580.099391:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787548580.099419:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e593 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099426:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548580.099443:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e593 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099450:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: 000000006a40b6e1/0xcb7c48919424e58c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e593 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099477:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548580.099478:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548580.099480:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548580.099499:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d54ae6a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431822592:0@lo:103: 00000100:00100000:1.0:1787548580.099527:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548580.099564:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431822592 00000100:00100000:1.0:1787548580.099568:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431822592 00010000:00010000:1.0:1787548580.099584:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000645173e3/0xcb7c48919424e593 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e58c expref: 12 pid: 5849 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548580.099600:0:6334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000324ae0e2 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6334:1874380431822464:0@lo:104: 00000100:00100000:1.0:1787548580.099602:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548580.099607:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c3a86c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:3316:x1874380431822592:12345-0@lo:103: 00010000:00010000:1.0:1787548580.099616:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548580.099621:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000645173e3/0xcb7c48919424e593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e58c expref: 12 pid: 5849 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099636:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000645173e3/0xcb7c48919424e593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e58c expref: 12 pid: 5849 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099647:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000645173e3/0xcb7c48919424e593 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e58c expref: 12 pid: 5849 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099660:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099667:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099678:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099684:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099689:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099694:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099699:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009d8c2a7b already unused, calling callback (000000005dc0ebeb) 00010000:00010000:1.0:1787548580.099701:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099707:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099725:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548580.099736:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787548580.099740:0:6334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548580.099748:0:6334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548580.099753:0:6334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548580.099759:0:6334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009d8c2a7b/0xcb7c48919424e5d2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548580.099761:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c3a86c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+11:3316:x1874380431822592:12345-0@lo:103: Request processed in 155us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548580.099768:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548580.099794:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d54ae6a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431822592:0@lo:103: 00010000:00010000:0.0:1787548580.294057:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548581.315321:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548581.892152:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d54ae6a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431822720:0@lo:400: 00000100:00100000:1.0:1787548581.892212:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548581.892260:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787548581.892266:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000955f8cd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431822848:0@lo:400: 00000100:00100000:1.0:1787548581.892297:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548581.892331:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431822848 00000100:00100000:1.0:1787548581.892337:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431822848 00000100:00100000:1.0:1787548581.892375:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548581.892381:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cef5299 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431822848:12345-0@lo:400: 00000100:00100000:1.0:1787548581.892421:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cef5299 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431822848:12345-0@lo:400: Request processed in 41us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548581.892428:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787548581.892473:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000955f8cd6 x1874380431822848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548581.892486:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000955f8cd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431822848:0@lo:400: 00000100:00100000:2.0:1787548581.893233:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431822720 00000100:00100000:2.0:1787548581.893240:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431822720 00000100:00100000:2.0:1787548581.893283:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787548581.893290:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4db95b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+11:3313:x1874380431822720:12345-0@lo:400: 00000100:00100000:2.0:1787548581.893333:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4db95b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+11:3313:x1874380431822720:12345-0@lo:400: Request processed in 44us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548581.893340:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787548581.893412:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d54ae6a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431822720:0@lo:400: 00010000:00010000:1.0:1787548582.342394:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548583.363307:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548584.387333:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787548585.344823:0:6687:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787548585.344829:0:6687:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787548585.345031:0:6687:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000af55be99 00000020:01000004:3.0:1787548585.345053:0:6687:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787548585.345067:0:6687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787548585.345083:0:6687:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000000871685c) 00000020:00000080:3.0:1787548585.345104:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787548585.360381:0:6687:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787548585.360884:0:6687:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787548585.384106:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787548585.390796:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787548585.390833:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787548585.390954:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787548585.390989:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787548585.391576:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787548585.391661:0:6687:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787548585.391681:0:6687:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcb7c48919424e5e0 00000020:01000004:3.0:1787548585.391692:0:6687:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787548585.391717:0:6687:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787548585.391721:0:6687:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787548585.391727:0:6687:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787548585.391732:0:6687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787548585.391745:0:6687:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000024a6f781) 00000020:00000080:3.0:1787548585.391756:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787548585.398376:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787548585.398698:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787548585.398707:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787548585.399532:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787548585.399542:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787548585.400057:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787548585.400065:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787548585.408925:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787548585.409196:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787548585.409203:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00010000:00010000:1.0:1787548585.411593:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548585.417104:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787548585.417125:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787548585.443887:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787548585.444489:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787548585.444498:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787548585.450326:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787548585.450349:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787548585.451486:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787548585.451499:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787548585.455580:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787548585.455881:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787548585.455889:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787548585.457074:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787548585.457085:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787548585.535202:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787548585.535469:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787548585.535476:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787548585.537289:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787548585.537305:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787548585.537880:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787548585.537972:0:6687:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787548585.537979:0:6687:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787548585.563247:0:6687:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787548585.563302:0:6687:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.113@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787548585.563311:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787548585.563313:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787548585.563314:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787548585.563315:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787548585.563316:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787548585.563318:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787548585.563319:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787548585.563320:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787548585.563322:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787548585.563323:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787548585.563324:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787548585.563328:0:6687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787548585.563330:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787548585.563331:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787548585.563332:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787548585.563333:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787548585.563334:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787548585.563335:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787548585.563335:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787548585.563336:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787548585.563337:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787548585.563338:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787548585.563339:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787548585.563372:0:6687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787548585.563393:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000908ac50a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431822976:0@lo:253: 00000100:00100000:0.0:1787548585.563497:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548585.563659:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f82f941a going to sleep for 11 seconds 00000100:00100000:2.0:1787548585.563877:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431822976 00000100:00100000:2.0:1787548585.563948:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431822976 00000100:00100000:2.0:1787548585.564125:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787548585.564172:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e362ec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+11:6687:x1874380431822976:12345-0@lo:253: 20000000:01000000:2.0:1787548585.564227:0:5848:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787548585.564232:0:5848:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787548585.564238:0:5848:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787548585.564241:0:5848:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787548585.565566:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787548585.567519:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787548585.567554:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787548585.567777:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787548585.567788:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787548585.567825:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787548585.567886:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787548585.568540:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787548585.568565:0:5848:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.113@tcp 20000000:01000000:2.0:1787548585.568567:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.113@tcp (null) (null) (null) 00000040:00080000:2.0:1787548585.568679:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787548585.568758:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787548585.568819:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787548585.568830:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.113@tcp (null) (null) 00000040:00080000:2.0:1787548585.568865:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787548585.568875:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787548585.568985:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787548585.569120:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787548585.570386:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787548585.570414:0:5848:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.113@tcp 20000000:01000000:2.0:1787548585.570416:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.113@tcp (null) (null) (null) 00000040:00080000:2.0:1787548585.570467:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787548585.570474:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787548585.570505:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787548585.570512:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.113@tcp (null) (null) 00000040:00080000:2.0:1787548585.570558:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787548585.570568:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787548585.570744:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1787548585.570806:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1787548585.570826:0:5848:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787548585.570830:0:5848:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787548585.570834:0:5848:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787548585.570848:0:5848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787548585.570850:0:5848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787548585.570948:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787548585.570952:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787548585.571977:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787548585.572375:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787548585.572423:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787548585.572517:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787548585.572532:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787548585.572534:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787548585.573847:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787548585.574077:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787548585.574410:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787548585.574987:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787548585.575108:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787548585.575340:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787548585.575356:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787548585.575358:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787548585.576109:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1787548585.576304:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1787548585.576547:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787548585.577338:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787548585.577390:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787548585.577428:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1787548585.577457:0:5848:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787548585.577460:0:5848:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787548585.577472:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787548585.577494:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.577517:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ce445f36/0xcb7c48919424e515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e50e expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.577524:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000069cd820d/0xcb7c48919424e531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e52a expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.577541:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009b011606/0xcb7c48919424e5a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e59a expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.577547:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.577667:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009b011606/0xcb7c48919424e5a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e59a expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.577746:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009b011606/0xcb7c48919424e5a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e59a expref: 11 pid: 5849 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548585.577768:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000040942ad5 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5848:1874380431823104:0@lo:104: 00000100:00100000:2.0:1787548585.577856:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787548585.577982:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000069cd820d/0xcb7c48919424e531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e52a expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.578000:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000069cd820d/0xcb7c48919424e531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e52a expref: 11 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548585.578009:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da603ade pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5848:1874380431823232:0@lo:104: 00000100:00100000:2.0:1787548585.578033:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787548585.578491:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ce445f36/0xcb7c48919424e515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e50e expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.578500:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ce445f36/0xcb7c48919424e515 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e50e expref: 11 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548585.578509:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084292433 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5848:1874380431823360:0@lo:104: 00000100:00100000:2.0:1787548585.578545:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548585.578598:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431823104 00000100:00100000:1.0:1787548585.578608:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431823104 00000100:00100000:1.0:1787548585.578655:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431823232 00000100:00100000:1.0:1787548585.578659:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431823232 00000100:00100000:1.0:1787548585.578674:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787548585.578683:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e902675 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+4:5848:x1874380431823104:12345-0@lo:104: 00010000:00010000:1.0:1787548585.578707:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e5a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.578770:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787548585.578777:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e902675 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+4:5848:x1874380431823104:12345-0@lo:104: Request processed in 95us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548585.578784:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787548585.578810:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787548585.578816:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000317c7228 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:5848:x1874380431823232:12345-0@lo:104: 00010000:00010000:1.0:1787548585.578824:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e531 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.578863:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787548585.578868:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000317c7228 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:5848:x1874380431823232:12345-0@lo:104: Request processed in 53us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548585.578873:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787548585.578902:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787548585.578908:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e5a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.578915:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000830a913 already unused, calling callback (0000000016f61675) 10000000:00010000:1.0:1787548585.578918:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e5a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.578926:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e5a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548585.578932:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e5a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548585.578937:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787548585.578968:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e5a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.578975:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548585.579003:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e5a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.579022:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: 000000000830a913/0xcb7c48919424e59a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e5a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.579036:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548585.579038:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e531 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.579044:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008e31ecca already unused, calling callback (0000000016f61675) 10000000:00010000:1.0:1787548585.579047:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e531 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.579052:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e531 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548585.579057:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e531 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548585.579061:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787548585.579074:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e531 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.579080:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548585.579084:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e531 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.579089:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: 000000008e31ecca/0xcb7c48919424e52a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e531 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.579099:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548585.579106:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548585.579108:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548585.579160:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d54ae6a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431823488:0@lo:103: 00000100:00100000:1.0:1787548585.579194:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548585.579221:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787548585.579226:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000955f8cd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431823616:0@lo:103: 00000100:00100000:1.0:1787548585.579247:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548585.579277:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431823488 00000100:00100000:1.0:1787548585.579281:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431823488 00010000:00010000:1.0:1787548585.579300:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009b011606/0xcb7c48919424e5a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e59a expref: 12 pid: 5849 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548585.579321:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431823616 00000100:00100000:1.0:1787548585.579324:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431823616 00010000:00010000:1.0:1787548585.579335:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000069cd820d/0xcb7c48919424e531 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e52a expref: 13 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548585.579349:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787548585.579355:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c1b90ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3418829f-2e19-44b5-ae62-1256ac42dc62+13:3315:x1874380431823488:12345-0@lo:103: 00010000:00010000:1.0:1787548585.579365:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548585.579371:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009b011606/0xcb7c48919424e5a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e59a expref: 13 pid: 5849 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.579381:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009b011606/0xcb7c48919424e5a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e59a expref: 13 pid: 5849 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.579398:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548585.579426:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c1b90ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3418829f-2e19-44b5-ae62-1256ac42dc62+13:3315:x1874380431823488:12345-0@lo:103: Request processed in 73us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548585.579433:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787548585.579468:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787548585.579473:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b731247 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3418829f-2e19-44b5-ae62-1256ac42dc62+12:3315:x1874380431823616:12345-0@lo:103: 00010000:00010000:1.0:1787548585.579481:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548585.579484:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000069cd820d/0xcb7c48919424e531 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e52a expref: 12 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.579493:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000069cd820d/0xcb7c48919424e531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e52a expref: 12 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.579503:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548585.579525:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b731247 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3418829f-2e19-44b5-ae62-1256ac42dc62+12:3315:x1874380431823616:12345-0@lo:103: Request processed in 53us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548585.579531:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787548585.579570:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000955f8cd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431823616:0@lo:103: 00000100:00100000:1.0:1787548585.579581:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d54ae6a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431823488:0@lo:103: 00010000:00010000:0.0:1787548585.579873:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548585.580194:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b20d8226 going to sleep for 11 seconds 00010000:00010000:2.0:1787548585.580214:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009b011606/0xcb7c48919424e5a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e59a expref: 11 pid: 5849 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548585.580226:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000040942ad5 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5848:1874380431823104:0@lo:104: 00010000:00010000:2.0:1787548585.580236:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000069cd820d/0xcb7c48919424e531 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e52a expref: 10 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548585.580242:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da603ade pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5848:1874380431823232:0@lo:104: 00000100:00100000:1.0:1787548585.580342:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431823360 00000100:00100000:1.0:1787548585.580348:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431823360 00000100:00100000:1.0:1787548585.580378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787548585.580385:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c3ee415 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:5848:x1874380431823360:12345-0@lo:104: 00010000:00010000:1.0:1787548585.580396:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e515 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.580517:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787548585.580523:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c3ee415 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:5848:x1874380431823360:12345-0@lo:104: Request processed in 139us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548585.580530:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787548585.580598:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084292433 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5848:1874380431823360:0@lo:104: 00010000:00010000:2.0:1787548585.580621:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.580840:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548585.580845:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e515 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.580853:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006243a1ca already unused, calling callback (0000000016f61675) 10000000:00010000:0.0:1787548585.580856:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e515 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.580882:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e515 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787548585.580951:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e515 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548585.580958:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787548585.581093:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e515 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581101:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787548585.581152:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e515 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581159:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e50e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e515 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581177:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548585.581179:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548585.581180:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548585.581226:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787548585.581240:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee4b9036 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431823744:0@lo:103: 00000100:00100000:3.0:1787548585.581283:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548585.581488:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431823744 00000100:00100000:0.0:1787548585.581495:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431823744 00010000:00010000:0.0:1787548585.581520:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ce445f36/0xcb7c48919424e515 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e50e expref: 10 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548585.581554:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787548585.581562:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050992038 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3418829f-2e19-44b5-ae62-1256ac42dc62+10:3314:x1874380431823744:12345-0@lo:103: 00010000:00010000:0.0:1787548585.581572:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548585.581576:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ce445f36/0xcb7c48919424e515 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e50e expref: 10 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581603:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ce445f36/0xcb7c48919424e515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e50e expref: 10 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581616:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce445f36/0xcb7c48919424e515 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e50e expref: 10 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581629:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581637:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581653:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581660:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581666:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581671:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581677:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000004c797fa already unused, calling callback (000000005dc0ebeb) 00010000:00010000:0.0:1787548585.581680:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581793:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581829:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.581840:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548585.581886:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050992038 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3418829f-2e19-44b5-ae62-1256ac42dc62+9:3314:x1874380431823744:12345-0@lo:103: Request processed in 325us (602us total) trans 0 rc 0/0 00010000:00010000:3.0:1787548585.582004:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.582013:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.582018:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000004c797fa/0xcb7c48919424e5ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787548585.582034:0:5848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787548585.582165:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787548585.582209:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee4b9036 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431823744:0@lo:103: 00000100:00100000:1.0:1787548585.620781:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e362ec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+8:6687:x1874380431822976:12345-0@lo:253: Request processed in 56603us (57275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548585.620821:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787548585.620954:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000908ac50a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431822976:0@lo:253: 10000000:01000000:2.0:1787548585.620972:0:6687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787548585.620976:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787548585.620978:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787548585.620980:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787548585.620981:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787548585.620983:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787548585.620984:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787548585.620985:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787548585.620987:0:6687:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787548585.620988:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787548585.620990:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787548585.621012:0:6687:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000af55be99 from lustre-OST0000 10000000:01000000:2.0:1787548585.621059:0:6687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787548585.621062:0:6687:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787548585.621070:0:6687:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fec87eab370 local copy 10000000:01000000:2.0:1787548585.621075:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787548585.621126:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.621160:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.621169:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548585.621191:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084292433 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431823872:0@lo:101: 00000100:00100000:2.0:1787548585.621235:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548585.621334:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bfb1533c going to sleep for 11 seconds 00000100:00100000:1.0:1787548585.621407:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431823872 00000100:00100000:1.0:1787548585.621416:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431823872 00000100:00100000:1.0:1787548585.621513:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787548585.621523:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b2c3cae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+8:6687:x1874380431823872:12345-0@lo:101: 00010000:00010000:1.0:1787548585.621537:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548585.621551:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007bea9a07/0xcb7c48919424e5fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e5f5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.621576:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007bea9a07/0xcb7c48919424e5fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e5f5 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.621586:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007bea9a07/0xcb7c48919424e5fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e5f5 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.621597:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007bea9a07, rc 0) 00000100:00100000:1.0:1787548585.621638:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b2c3cae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+9:6687:x1874380431823872:12345-0@lo:101: Request processed in 117us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548585.621645:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787548585.621720:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084292433 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431823872:0@lo:101: 00010000:00010000:2.0:1787548585.621732:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcb7c48919424e5fc expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.621740:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcb7c48919424e5fc expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548585.621859:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084292433 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431824000:0@lo:501: 00000100:00100000:2.0:1787548585.621887:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548585.622054:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bfb1533c going to sleep for 11 seconds 00000100:00100000:3.0:1787548585.622218:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431824000 00000100:00100000:3.0:1787548585.622223:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431824000 00000100:00100000:3.0:1787548585.622249:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787548585.622266:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b72526a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+9:6687:x1874380431824000:12345-0@lo:501: 00000100:00100000:3.0:1787548585.622514:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b72526a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+9:6687:x1874380431824000:12345-0@lo:501: Request processed in 248us (625us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787548585.622521:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787548585.622601:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084292433 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431824000:0@lo:501: 10000000:01000000:2.0:1787548585.622616:0:6687:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787548585.622643:0:6687:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787548585.622649:0:6687:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcb7c48919424e5fc expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.622657:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcb7c48919424e5fc expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.622669:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcb7c48919424e5fc expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.622704:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787548585.622726:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fecad08a800 10000000:01000000:2.0:1787548585.622731:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787548585.622736:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8fec87eab370 10000000:01000000:2.0:1787548585.622738:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787548585.622742:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8fec87eab370 from 1 10000000:01000000:2.0:1787548585.622745:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787548585.622766:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: 0000000004c797fa/0xcb7c48919424e603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.622773:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: 0000000004c797fa/0xcb7c48919424e603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.622781:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: 0000000004c797fa/0xcb7c48919424e603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548585.622794:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084292433 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431824128:0@lo:101: 00000100:00100000:2.0:1787548585.622822:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548585.622844:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ee63d96 going to sleep for 11 seconds 00010000:00010000:3.0:1787548585.622947:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548585.622954:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcb7c48919424e5fc expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.622962:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000127b0537 already unused, calling callback (0000000016f61675) 10000000:00010000:3.0:1787548585.622965:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcb7c48919424e5fc expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.622972:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xcb7c48919424e5fc expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787548585.622979:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xcb7c48919424e5fc expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548585.622984:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787548585.623006:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcb7c48919424e5fc expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.623012:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787548585.623043:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcb7c48919424e5fc expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.623050:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: 00000000127b0537/0xcb7c48919424e5f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcb7c48919424e5fc expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548585.623066:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431824128 00010000:00010000:3.0:1787548585.623070:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548585.623073:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431824128 00010000:00010000:3.0:1787548585.623079:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548585.623082:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548585.623127:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787548585.623151:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002caee645 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+9:6687:x1874380431824128:12345-0@lo:101: 00000100:00100000:2.0:1787548585.623155:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787548585.623161:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787548585.623170:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076c44b77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431824256:0@lo:103: 00010000:00010000:1.0:1787548585.623177:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000062bdeab7/0xcb7c48919424e60a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e603 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.623200:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000062bdeab7/0xcb7c48919424e60a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e603 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548585.623206:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787548585.623223:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000062bdeab7/0xcb7c48919424e60a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e603 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.623233:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000062bdeab7, rc 0) 00000100:00100000:2.0:1787548585.623251:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431824256 00000100:00100000:2.0:1787548585.623256:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431824256 00000100:00100000:1.0:1787548585.623278:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002caee645 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+11:6687:x1874380431824128:12345-0@lo:101: Request processed in 129us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548585.623286:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787548585.623297:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787548585.623307:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da603ade pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+10:3313:x1874380431824256:12345-0@lo:103: 00010000:00010000:2.0:1787548585.623325:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548585.623338:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007bea9a07/0xcb7c48919424e5fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424e5f5 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.623351:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548585.623397:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da603ade pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+9:3313:x1874380431824256:12345-0@lo:103: Request processed in 93us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548585.623403:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787548585.623455:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084292433 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431824128:0@lo:101: 00010000:00010000:2.0:1787548585.623466:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: 0000000004c797fa/0xcb7c48919424e603 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e60a expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.623475:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: 0000000004c797fa/0xcb7c48919424e603 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e60a expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548585.623493:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787548585.623507:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: 0000000004c797fa/0xcb7c48919424e603 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e60a expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.623514:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: 0000000004c797fa/0xcb7c48919424e603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e60a expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548585.623521:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787548585.623526:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787548585.623531:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787548585.623534:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787548585.623546:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.623564:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.623571:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548585.623583:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084292433 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431824384:0@lo:101: 00000100:00100000:2.0:1787548585.623608:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548585.623634:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ee63d96 going to sleep for 11 seconds 00000100:00100000:0.0:1787548585.623642:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431824384 00000100:00100000:0.0:1787548585.623648:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431824384 00000100:00100000:3.0:1787548585.623778:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787548585.623831:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076c44b77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431824256:0@lo:103: 00000100:00100000:3.0:1787548585.623869:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047be4097 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+9:6687:x1874380431824384:12345-0@lo:101: 00010000:00010000:3.0:1787548585.623877:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548585.623887:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000273ea068/0xcb7c48919424e618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e611 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.623900:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000273ea068/0xcb7c48919424e618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e611 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.623907:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000273ea068/0xcb7c48919424e618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e611 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.623914:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000273ea068, rc 0) 00000100:00100000:3.0:1787548585.623952:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047be4097 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+10:6687:x1874380431824384:12345-0@lo:101: Request processed in 88us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548585.623958:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787548585.623999:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084292433 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431824384:0@lo:101: 00010000:00010000:0.0:1787548585.624013:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e618 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.624021:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e618 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548585.624124:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee4b9036 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431824512:0@lo:501: 00000100:00100000:0.0:1787548585.624174:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548585.624212:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f82f941a going to sleep for 11 seconds 00000100:00100000:1.0:1787548585.624219:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431824512 00000100:00100000:1.0:1787548585.624225:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431824512 00000100:00100000:1.0:1787548585.624257:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787548585.624263:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000883865c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+10:6687:x1874380431824512:12345-0@lo:501: 00000100:00100000:1.0:1787548585.624508:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000883865c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+10:6687:x1874380431824512:12345-0@lo:501: Request processed in 245us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548585.624515:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787548585.624593:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee4b9036 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431824512:0@lo:501: 00000100:00100000:0.0:1787548585.624622:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee4b9036 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431824640:0@lo:503: 00000100:00100000:0.0:1787548585.624664:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548585.624771:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431824640 00000100:00100000:3.0:1787548585.624775:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431824640 00000100:00100000:0.0:1787548585.624793:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f82f941a going to sleep for 11 seconds 00000100:00100000:3.0:1787548585.624809:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787548585.624817:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e99eea78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+10:6687:x1874380431824640:12345-0@lo:503: 00000100:00100000:3.0:1787548585.624999:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e99eea78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+10:6687:x1874380431824640:12345-0@lo:503: Request processed in 182us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548585.625006:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787548585.625056:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee4b9036 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431824640:0@lo:503: 00000040:00080000:0.0:1787548585.625532:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787548585.625608:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee4b9036 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431824768:0@lo:502: 00000100:00100000:0.0:1787548585.625653:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548585.625820:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f82f941a going to sleep for 11 seconds 00000100:00100000:2.0:1787548585.625873:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431824768 00000100:00100000:2.0:1787548585.625879:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431824768 00000100:00100000:2.0:1787548585.626038:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787548585.626047:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096897629 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+10:6687:x1874380431824768:12345-0@lo:502: 00000100:00100000:2.0:1787548585.626258:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096897629 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+10:6687:x1874380431824768:12345-0@lo:502: Request processed in 212us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548585.626266:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787548585.627052:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee4b9036 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431824768:0@lo:502: 00000040:00080000:3.0:1787548585.628696:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787548585.628797:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787548585.628871:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787548585.628948:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787548585.628991:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787548585.629023:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787548585.629077:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acdcb731 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431824896:0@lo:502: 00000100:00100000:3.0:1787548585.629206:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548585.629253:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae400eed going to sleep for 11 seconds 00000100:00100000:2.0:1787548585.629403:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431824896 00000100:00100000:2.0:1787548585.629413:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431824896 00000100:00100000:2.0:1787548585.629488:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787548585.629497:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009335e746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+10:6687:x1874380431824896:12345-0@lo:502: 00000100:00100000:2.0:1787548585.629905:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009335e746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+10:6687:x1874380431824896:12345-0@lo:502: Request processed in 407us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548585.629913:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787548585.630012:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acdcb731 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431824896:0@lo:502: 00000040:00080000:0.0:1787548585.630176:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787548585.630196:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787548585.631110:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787548585.631122:0:6706:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787548585.631230:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548585.631233:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787548585.631240:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787548585.631258:0:6706:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000d3210083) 00000020:00000080:0.0:1787548585.631287:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787548585.631293:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787548585.631445:0:6706:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000af55be99 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787548585.631456:0:6706:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787548585.631464:0:6706:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcb7c48919424e626 00010000:00010000:0.0:1787548585.637507:0:6706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787548585.637785:0:6706:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787548585.646996:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787548585.647318:0:6706:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787548585.672572:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787548585.673078:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787548585.692095:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787548585.692106:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787548585.692112:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787548585.692114:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787548585.692123:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787548585.692126:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787548585.692153:0:6706:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787548585.692158:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787548585.692159:0:6706:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787548585.692216:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787548585.692220:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787548585.692221:0:6706:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787548585.692224:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787548585.693553:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787548585.693600:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787548585.693619:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e611 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e618 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.693632:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: 000000006243a1ca/0xcb7c48919424e611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e618 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548585.693641:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fecad08a800 from 1 10000000:01000000:0.0:1787548585.693661:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787548585.693695:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: 00000000ce445f36/0xcb7c48919424e62d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.693701:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: 00000000ce445f36/0xcb7c48919424e62d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.693711:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: 00000000ce445f36/0xcb7c48919424e62d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548585.693734:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3a9f743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825024:0@lo:101: 00000100:00100000:0.0:1787548585.693795:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548585.693839:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e481ac46 going to sleep for 11 seconds 00000100:00100000:1.0:1787548585.693982:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431825024 00000100:00100000:1.0:1787548585.693990:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431825024 00000100:00100000:1.0:1787548585.694024:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787548585.694030:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2d0fabd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+10:6687:x1874380431825024:12345-0@lo:101: 00010000:00010000:1.0:1787548585.694042:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548585.694052:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007bea9a07/0xcb7c48919424e634 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e62d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.694070:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007bea9a07/0xcb7c48919424e634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e62d expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.694086:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007bea9a07/0xcb7c48919424e634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e62d expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548585.694094:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007bea9a07, rc 0) 00000100:00100000:1.0:1787548585.694125:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2d0fabd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+11:6687:x1874380431825024:12345-0@lo:101: Request processed in 95us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548585.694150:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787548585.694453:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3a9f743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825024:0@lo:101: 00010000:00010000:0.0:1787548585.694468:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: 00000000ce445f36/0xcb7c48919424e62d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e634 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.694474:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: 00000000ce445f36/0xcb7c48919424e62d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e634 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548585.694559:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3a9f743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825152:0@lo:501: 00000100:00100000:0.0:1787548585.694695:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548585.694725:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e481ac46 going to sleep for 11 seconds 00000100:00100000:2.0:1787548585.694853:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431825152 00000100:00100000:2.0:1787548585.694858:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431825152 00000100:00100000:2.0:1787548585.694893:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787548585.694900:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3c444c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+11:6687:x1874380431825152:12345-0@lo:501: 00000100:00100000:2.0:1787548585.696097:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3c444c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+11:6687:x1874380431825152:12345-0@lo:501: Request processed in 1194us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548585.696108:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787548585.696324:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3a9f743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825152:0@lo:501: 00000100:00100000:0.0:1787548585.696365:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3a9f743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825280:0@lo:503: 00000100:00100000:0.0:1787548585.696413:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548585.696467:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e481ac46 going to sleep for 11 seconds 00000100:00100000:1.0:1787548585.696564:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431825280 00000100:00100000:1.0:1787548585.696571:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431825280 00000100:00100000:1.0:1787548585.696675:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787548585.696684:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d067cff8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+11:6687:x1874380431825280:12345-0@lo:503: 00000100:00100000:1.0:1787548585.696834:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d067cff8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+11:6687:x1874380431825280:12345-0@lo:503: Request processed in 152us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548585.696840:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787548585.697019:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3a9f743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825280:0@lo:503: 00000040:00080000:0.0:1787548585.697398:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787548585.697483:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3a9f743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825408:0@lo:502: 00000100:00100000:0.0:1787548585.697522:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548585.701472:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e481ac46 going to sleep for 11 seconds 00000100:00100000:1.0:1787548585.707211:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431825408 00000100:00100000:1.0:1787548585.707224:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431825408 00000100:00100000:1.0:1787548585.708700:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787548585.708716:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd6c0483 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+11:6687:x1874380431825408:12345-0@lo:502: 00000100:00100000:1.0:1787548585.708966:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd6c0483 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+11:6687:x1874380431825408:12345-0@lo:502: Request processed in 255us (11443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548585.708974:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787548585.709192:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3a9f743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825408:0@lo:502: 00000040:00080000:0.0:1787548585.709505:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787548585.709561:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787548585.709663:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3a9f743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825536:0@lo:502: 00000100:00100000:0.0:1787548585.709710:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548585.714742:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e481ac46 going to sleep for 11 seconds 00000100:00100000:2.0:1787548585.714841:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431825536 00000100:00100000:2.0:1787548585.714850:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431825536 00000100:00100000:2.0:1787548585.714896:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787548585.714904:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037b91d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+11:6687:x1874380431825536:12345-0@lo:502: 00000100:00100000:2.0:1787548585.715167:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037b91d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+11:6687:x1874380431825536:12345-0@lo:502: Request processed in 264us (5456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548585.715175:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787548585.715306:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3a9f743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825536:0@lo:502: 00000040:00080000:3.0:1787548585.715463:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787548585.715479:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787548585.716316:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787548585.716326:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548585.716329:0:6710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787548585.716336:0:6710:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fecad08a800 00000020:00000080:3.0:1787548585.716338:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787548585.716373:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787548585.716377:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548585.716378:0:6710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787548585.716381:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787548585.716415:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787548585.716447:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787548585.716461:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e62d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e634 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.716472:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e62d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e634 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548585.716504:0:6687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787548585.716507:0:6687:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fecad08a800 10000000:01000000:3.0:1787548585.716509:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fecad08a800 10000000:01000000:3.0:1787548585.716512:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787548585.716522:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fecad08a800 from 1 10000000:01000000:3.0:1787548585.716525:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787548585.716552:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.716558:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.716568:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548585.716584:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825664:0@lo:101: 00000100:00100000:3.0:1787548585.716771:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548585.716796:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec895830c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548585.716896:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431825664 00000100:00100000:2.0:1787548585.716901:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431825664 00000100:00100000:2.0:1787548585.716926:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787548585.716932:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+11:6687:x1874380431825664:12345-0@lo:101: 00010000:00010000:2.0:1787548585.716942:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548585.716952:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecc21ece00/0xcb7c48919424e642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e63b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.716977:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecc21ece00/0xcb7c48919424e642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e63b expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.716985:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecc21ece00/0xcb7c48919424e642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e63b expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.716993:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ece00, rc 0) 00000100:00100000:2.0:1787548585.717033:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:6687:x1874380431825664:12345-0@lo:101: Request processed in 101us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548585.717039:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787548585.717098:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825664:0@lo:101: 00010000:00010000:3.0:1787548585.717108:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e642 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.717116:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e642 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548585.717208:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825792:0@lo:501: 00000100:00100000:3.0:1787548585.717231:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548585.717246:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec895830c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548585.717355:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431825792 00000100:00100000:2.0:1787548585.717359:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431825792 00000100:00100000:2.0:1787548585.717377:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787548585.717382:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:6687:x1874380431825792:12345-0@lo:501: 00000100:00100000:2.0:1787548585.717579:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:6687:x1874380431825792:12345-0@lo:501: Request processed in 195us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548585.717598:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787548585.717709:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825792:0@lo:501: 00000100:00100000:3.0:1787548585.717733:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825920:0@lo:503: 00000100:00100000:3.0:1787548585.717770:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548585.717796:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec895830c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548585.717851:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431825920 00000100:00100000:1.0:1787548585.717856:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431825920 00000100:00100000:1.0:1787548585.717878:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787548585.717885:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+12:6687:x1874380431825920:12345-0@lo:503: 00000100:00100000:1.0:1787548585.718029:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+12:6687:x1874380431825920:12345-0@lo:503: Request processed in 144us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548585.718042:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787548585.718162:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431825920:0@lo:503: 00000040:00080000:3.0:1787548585.719566:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787548585.719715:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431826048:0@lo:502: 00000100:00100000:3.0:1787548585.719770:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548585.719810:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec895830c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548585.719891:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431826048 00000100:00100000:2.0:1787548585.719898:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431826048 00000100:00100000:2.0:1787548585.719928:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787548585.719935:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:6687:x1874380431826048:12345-0@lo:502: 00000100:00100000:2.0:1787548585.720160:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:6687:x1874380431826048:12345-0@lo:502: Request processed in 224us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548585.720168:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787548585.720685:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431826048:0@lo:502: 00000040:00080000:3.0:1787548585.720916:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787548585.720957:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787548585.720982:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787548585.721016:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787548585.721044:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787548585.724777:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787548585.724831:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787548585.724868:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787548585.724937:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787548585.724983:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787548585.725310:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787548585.725365:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787548585.725402:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787548585.725450:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787548585.725502:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787548585.725540:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787548585.725576:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787548585.725704:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787548585.725740:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787548585.725773:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787548585.725821:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787548585.725856:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787548585.725886:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787548585.725929:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787548585.725989:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787548585.726025:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787548585.726073:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787548585.726103:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787548585.726175:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431826176:0@lo:502: 00000100:00100000:3.0:1787548585.726239:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548585.726274:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec895830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548585.726471:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431826176 00000100:00100000:0.0:1787548585.726477:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431826176 00000100:00100000:0.0:1787548585.726522:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787548585.726531:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:6687:x1874380431826176:12345-0@lo:502: 00000100:00100000:0.0:1787548585.726719:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:6687:x1874380431826176:12345-0@lo:502: Request processed in 189us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548585.726726:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787548585.726918:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431826176:0@lo:502: 00000040:00080000:3.0:1787548585.726978:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787548585.726986:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787548585.728086:0:6711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787548585.728111:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8feb811e99b8) 00000020:00000080:1.0:1787548585.728402:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787548585.728525:0:6711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fecad08a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787548585.728529:0:6711:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fecad08a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787548585.728532:0:6711:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fecad08a800 3 00010000:00080000:0.0:1787548585.728558:0:6711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fecb3412800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.113@tcp at head 00010000:00010000:0.0:1787548585.731907:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787548585.732163:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787548585.732200:0:6711:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787548585.732212:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcb7c48919424e650 00000100:00080000:0.0:1787548585.732222:0:6711:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787548585.732227:0:6711:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8fecb3412800 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:0.0:1787548585.732275:0:6711:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecad282a00 x1874380431826304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787548585.732298:0:6711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787548585.732550:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1874380431826304:0@lo:38: 00000100:00100000:1.0:1787548585.732624:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548585.732807:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787548585.732816:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431826432:0@lo:400: 00000100:00100000:3.0:1787548585.732846:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548585.732875:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431826304 00000100:00100000:3.0:1787548585.732880:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431826304 00000100:00100000:3.0:1787548585.732901:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431826432 00000100:00100000:3.0:1787548585.732903:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431826432 00000100:00100000:3.0:1787548585.732922:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787548585.732929:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431826432:12345-0@lo:400: 00000100:00100000:3.0:1787548585.732969:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431826432:12345-0@lo:400: Request processed in 40us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548585.732975:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787548585.732988:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787548585.732992:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec88298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874380431826304:12345-0@lo:38: 00010000:00080000:3.0:1787548585.733007:0:5854:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1787548585.733034:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcb7c48919424e657 00000004:00100000:3.0:1787548585.733045:0:5854:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787548585.733067:0:5854:0:(import.c:65:import_set_state_nolock()) ffff8feb81196800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787548585.733107:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec88298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874380431826304:12345-0@lo:38: Request processed in 113us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548585.733113:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787548585.733164:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8feca71da680 x1874380431826432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548585.733178:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431826432:0@lo:400: 00010000:00080000:3.0:1787548585.733207:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fecad282a00 x1874380431826304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787548595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548585.733215:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787548585.733221:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787548585.733228:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787548585.733231:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787548585.733233:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fecb3412800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787548585.733238:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1874380431826304:0@lo:38: 00000040:00080000:1.0:1787548585.736020:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787548585.736218:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787548585.736246:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787548585.736266:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e642 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.736278:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e642 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787548585.736330:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787548585.736332:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787548585.736334:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787548585.736335:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787548585.736336:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787548585.736338:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787548585.736345:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787548585.736346:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787548585.736347:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787548585.736349:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787548585.736350:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787548585.736353:0:6687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787548585.736355:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787548585.736356:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787548585.736357:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787548585.736358:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787548585.736359:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787548585.736360:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787548585.736360:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787548585.736361:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787548585.736362:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787548585.736363:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787548585.736364:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787548585.736386:0:6687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787548585.736402:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431826560:0@lo:253: 00000100:00100000:3.0:1787548585.736485:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548585.736517:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec89583180 going to sleep for 11 seconds 00000100:00100000:0.0:1787548585.736700:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431826560 00000100:00100000:0.0:1787548585.736706:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431826560 00000100:00100000:0.0:1787548585.736746:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787548585.736754:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:6687:x1874380431826560:12345-0@lo:253: 20000000:01000000:0.0:1787548585.736778:0:5846:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787548585.736790:0:5846:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787548585.757775:0:5846:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787548585.757794:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787548585.757899:0:5871:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787548585.757903:0:5871:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787548585.757923:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.757950:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec80030a00/0xcb7c48919424e5cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e5c4 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.757959:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.757993:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec80030a00/0xcb7c48919424e5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e5c4 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.758006:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fec80030a00/0xcb7c48919424e5cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e5c4 expref: 12 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548585.758020:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5871:1874380431826688:0@lo:104: 00000100:00100000:2.0:1787548585.758073:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548585.758121:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787548585.758209:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431826688 00000100:00100000:0.0:1787548585.758216:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431826688 00000100:00100000:0.0:1787548585.758261:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787548585.758269:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:5871:x1874380431826688:12345-0@lo:104: 00010000:00010000:0.0:1787548585.758281:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fecc21edc00/0xcb7c48919424e5c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e5cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.758331:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787548585.758336:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:5871:x1874380431826688:12345-0@lo:104: Request processed in 68us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548585.758343:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787548585.758363:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548585.758369:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecc21edc00/0xcb7c48919424e5c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e5cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.758387:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21edc00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:0.0:1787548585.758392:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecc21edc00/0xcb7c48919424e5c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e5cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.758407:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecc21edc00/0xcb7c48919424e5c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e5cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787548585.758414:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecc21edc00/0xcb7c48919424e5c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e5cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548585.758419:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787548585.758453:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fecc21edc00/0xcb7c48919424e5c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e5cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.758460:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787548585.758481:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecc21edc00/0xcb7c48919424e5c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e5cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.758488:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecc21edc00/0xcb7c48919424e5c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e5cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548585.758503:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548585.758505:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548585.758507:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548585.758601:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5871:1874380431826688:0@lo:104: 00010000:00010000:2.0:1787548585.758617:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548585.758763:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431826816:0@lo:103: 00000100:00100000:3.0:1787548585.758797:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548585.758863:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431826816 00000100:00100000:2.0:1787548585.758867:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431826816 00010000:00010000:2.0:1787548585.758883:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec80030a00/0xcb7c48919424e5cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e5c4 expref: 13 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548585.758909:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787548585.758915:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+13:3316:x1874380431826816:12345-0@lo:103: 00010000:00010000:2.0:1787548585.758925:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548585.762170:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec80030a00/0xcb7c48919424e5cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e5c4 expref: 13 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.762207:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec80030a00/0xcb7c48919424e5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e5c4 expref: 13 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.762225:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec80030a00/0xcb7c48919424e5cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e5c4 expref: 13 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.762242:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.762251:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787548585.762266:0:5839:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004362782s 00010000:00010000:2.0:1787548585.762270:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.762278:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.762285:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.762291:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.762297:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec200 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548585.762301:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.762309:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.762330:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548585.762340:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548585.762417:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:3316:x1874380431826816:12345-0@lo:103: Request processed in 3501us (3618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548585.762427:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787548585.762754:0:5871:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.762763:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548585.762770:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e65e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548585.762903:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431826816:0@lo:103: 00000100:00100000:1.0:1787548585.778266:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+11:6687:x1874380431826560:12345-0@lo:253: Request processed in 41505us (41773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548585.778279:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787548585.778358:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:6687:1874380431826560:0@lo:253: 10000000:01000000:3.0:1787548585.778373:0:6687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787548585.778389:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787548585.778391:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787548585.778392:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787548585.778393:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787548585.778394:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787548585.778395:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787548585.778397:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787548585.778398:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787548585.778400:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787548585.778401:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787548585.778402:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787548585.778416:0:6687:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787548585.783897:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548585.784115:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787548585.784352:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548585.784521:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787548585.788343:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548585.788701:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787548585.794445:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:0.0:1787548586.051432:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787548586.051447:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fec8644c800 from 21 10000000:01000000:0.0:1787548586.051453:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787548586.051494:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.051505:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.051533:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548586.051556:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431826944:0@lo:101: 00000100:00100000:0.0:1787548586.051691:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.051790:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787548586.059084:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431826944 00000100:00100000:1.0:1787548586.059101:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431826944 00000100:00100000:1.0:1787548586.059318:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787548586.059331:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+11:5851:x1874380431826944:12345-0@lo:101: 00010000:00010000:1.0:1787548586.059347:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548586.059365:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e66c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e665 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548586.059391:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e66c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e665 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548586.059401:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e66c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e665 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548586.059410:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7e00, rc 0) 00000100:00100000:1.0:1787548586.059493:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5851:x1874380431826944:12345-0@lo:101: Request processed in 165us (7802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548586.059500:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787548586.059561:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431826944:0@lo:101: 00010000:00010000:1.0:1787548586.059577:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e66c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548586.059598:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e66c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548586.059662:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8829bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431827072:0@lo:501: 00000100:00100000:1.0:1787548586.059694:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548586.059725:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb81083240 going to sleep for 11 seconds 00000100:00100000:1.0:1787548586.059739:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431827072 00000100:00100000:1.0:1787548586.059743:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431827072 00000100:00100000:1.0:1787548586.059766:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787548586.059773:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5851:x1874380431827072:12345-0@lo:501: 00000100:00100000:1.0:1787548586.060087:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5851:x1874380431827072:12345-0@lo:501: Request processed in 313us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548586.060095:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787548586.060126:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8829bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431827072:0@lo:501: 00000100:00100000:1.0:1787548586.060190:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8829bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431827200:0@lo:503: 00000100:00100000:1.0:1787548586.060228:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548586.060244:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb81083240 going to sleep for 11 seconds 00000100:00100000:1.0:1787548586.060257:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431827200 00000100:00100000:1.0:1787548586.060261:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431827200 00000100:00100000:1.0:1787548586.060280:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787548586.060286:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5851:x1874380431827200:12345-0@lo:503: 00000100:00100000:1.0:1787548586.060555:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5851:x1874380431827200:12345-0@lo:503: Request processed in 268us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548586.060572:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787548586.060619:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8829bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431827200:0@lo:503: 00000100:00100000:0.0:1787548586.061600:0:6715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:6715:1874380431827328:0@lo:502: 00000100:00100000:0.0:1787548586.061647:0:6715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.061685:0:6715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a480 going to sleep for 11 seconds 00000100:00100000:1.0:1787548586.061786:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431827328 00000100:00100000:1.0:1787548586.061793:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431827328 00000100:00100000:1.0:1787548586.061835:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787548586.061844:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:6715:x1874380431827328:12345-0@lo:502: 00000100:00100000:1.0:1787548586.062095:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:6715:x1874380431827328:12345-0@lo:502: Request processed in 251us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548586.062102:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787548586.062247:0:6715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:6715:1874380431827328:0@lo:502: 00000100:00100000:1.0:1787548586.062297:0:6715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8829bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:6715:1874380431827456:0@lo:502: 00000100:00100000:1.0:1787548586.062405:0:6715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548586.062429:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431827456 00000100:00100000:1.0:1787548586.062442:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431827456 00000100:00100000:1.0:1787548586.062468:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787548586.062474:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+12:6715:x1874380431827456:12345-0@lo:502: 00000100:00100000:1.0:1787548586.062759:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+12:6715:x1874380431827456:12345-0@lo:502: Request processed in 284us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548586.062766:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787548586.062801:0:6715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb810839c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548586.062814:0:6715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8829bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:6715:1874380431827456:0@lo:502: 00000040:00080000:1.0:1787548586.062836:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787548586.062987:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787548586.063004:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787548586.063012:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e66c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.063023:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e66c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548586.063031:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787548586.063034:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fec8644c800 from 4 10000000:01000000:0.0:1787548586.063037:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787548586.063062:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.063069:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.063078:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548586.063101:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431827584:0@lo:101: 00000100:00100000:0.0:1787548586.063157:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.063188:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548586.063336:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431827584 00000100:00100000:1.0:1787548586.063341:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431827584 00000100:00100000:1.0:1787548586.063373:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787548586.063387:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5851:x1874380431827584:12345-0@lo:101: 00010000:00010000:1.0:1787548586.063396:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548586.063408:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec813f6a00/0xcb7c48919424e67a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e673 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548586.063429:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec813f6a00/0xcb7c48919424e67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e673 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548586.063450:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec813f6a00/0xcb7c48919424e67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e673 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548586.063459:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6a00, rc 0) 00000100:00100000:1.0:1787548586.063489:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+13:5851:x1874380431827584:12345-0@lo:101: Request processed in 103us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548586.063495:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787548586.063694:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431827584:0@lo:101: 00010000:00010000:0.0:1787548586.063707:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e67a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.063717:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e67a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548586.063761:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431827712:0@lo:256: 00000100:00100000:0.0:1787548586.063793:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.063820:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548586.064542:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431827712 00000100:00100000:1.0:1787548586.064549:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431827712 00000100:00100000:1.0:1787548586.064908:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787548586.064920:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+13:5851:x1874380431827712:12345-0@lo:256: 20000000:01000000:1.0:1787548586.064937:0:5848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787548586.064953:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787548586.064956:0:5848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787548586.065057:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+13:5851:x1874380431827712:12345-0@lo:256: Request processed in 139us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548586.065486:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431827712:0@lo:256: 10000000:01000000:0.0:1787548586.065531:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787548586.065540:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e67a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.065550:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e67a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548586.065558:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787548586.065561:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787548586.065563:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787548586.065600:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.065620:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.065629:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548586.065646:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431827840:0@lo:101: 00000100:00100000:0.0:1787548586.065679:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.065708:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548586.065723:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431827840 00000100:00100000:0.0:1787548586.065728:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431827840 00002000:00080000:3.0:1787548586.066690:0:6687:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787548586.066697:0:6687:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787548586.066727:0:6687:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787548586.066786:0:6687:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787548586.066800:0:6687:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787548586.066826:0:6687:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000100:00100000:1.0:1787548586.067689:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787548586.069751:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787548586.069768:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+13:5851:x1874380431827840:12345-0@lo:101: 00010000:00010000:0.0:1787548586.069784:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548586.069801:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec80031800/0xcb7c48919424e688 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e681 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.069827:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec80031800/0xcb7c48919424e688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e681 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.069838:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec80031800/0xcb7c48919424e688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e681 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.069847:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec80031800, rc 0) 00000100:00100000:0.0:1787548586.069917:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431827840:12345-0@lo:101: Request processed in 155us (4237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548586.069924:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787548586.069973:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431827840:0@lo:101: 00010000:00010000:0.0:1787548586.069997:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e688 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.070005:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e688 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548586.070062:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431827968:0@lo:501: 00000100:00100000:0.0:1787548586.070091:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.070119:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548586.070273:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431827968 00000100:00100000:1.0:1787548586.070279:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431827968 00000100:00100000:1.0:1787548586.070307:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787548586.070666:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431827968:12345-0@lo:501: 00000100:00100000:1.0:1787548586.070886:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431827968:12345-0@lo:501: Request processed in 572us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548586.070893:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787548586.070931:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431827968:0@lo:501: 00000100:00100000:1.0:1787548586.070970:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8829bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431828096:0@lo:503: 00000100:00100000:1.0:1787548586.071008:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548586.071029:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb81083e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787548586.071042:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431828096 00000100:00100000:1.0:1787548586.071045:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431828096 00000100:00100000:1.0:1787548586.071064:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787548586.071070:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431828096:12345-0@lo:503: 00000100:00100000:1.0:1787548586.077772:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431828096:12345-0@lo:503: Request processed in 6694us (6756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548586.077786:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787548586.082308:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8829bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431828096:0@lo:503: 00000100:00100000:0.0:1787548586.083508:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad280a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:6717:1874380431828224:0@lo:502: 00000100:00100000:0.0:1787548586.083581:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.085472:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431828224 00000100:00100000:0.0:1787548586.085483:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431828224 00000100:00100000:0.0:1787548586.085532:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787548586.085541:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+14:6717:x1874380431828224:12345-0@lo:502: 00000100:00100000:0.0:1787548586.087542:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+14:6717:x1874380431828224:12345-0@lo:502: Request processed in 1994us (3952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548586.087555:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787548586.088285:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548586.088747:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad280a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:6717:1874380431828224:0@lo:502: 00000020:01000000:1.0:1787548586.090908:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787548586.090919:0:6717:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787548586.090926:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548586.090928:0:6717:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787548586.090933:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787548586.090938:0:6717:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.113@tcp to nid 0x20000c0a8ce71 (192.168.206.113@tcp) 00000020:01000000:1.0:1787548586.090961:0:6717:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787548586.090964:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787548586.090978:0:6717:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8feb811ecd28) 00000020:00000080:1.0:1787548586.090999:0:6717:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787548586.091004:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787548586.091088:0:6717:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787548586.091092:0:6717:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787548586.091098:0:6717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb7c48919424e696 00010000:00080000:1.0:1787548586.091124:0:6717:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fecad8a0800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.113@tcp at head 00010000:00010000:1.0:1787548586.093609:0:6717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787548586.180073:0:6717:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787548586.180099:0:6717:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787548586.186233:0:6717:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787548586.186427:0:6717:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787548586.186491:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787548586.186543:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787548586.192975:0:6721:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787548586.192983:0:6721:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787548586.198021:0:6717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787548586.198045:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787548586.198083:0:6717:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787548586.198104:0:6717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb7c48919424e69d 00000100:00080000:1.0:1787548586.198113:0:6717:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787548586.198119:0:6717:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fecad8a0800 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:1.0:1787548586.198477:0:6717:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fec8829a300 x1874380431828352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787548586.198504:0:6717:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787548586.198562:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548586.198567:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548586.198569:0:6717:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787548586.198573:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548586.198578:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548586.198579:0:6717:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787548586.198584:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787548586.198585:0:6717:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787548586.198614:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88299880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:6717:1874380431828480:0@lo:502: 00000100:00100000:1.0:1787548586.198701:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548586.198753:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787548586.198819:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431828480 00000100:00100000:1.0:1787548586.198831:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431828480 00000100:00100000:1.0:1787548586.198873:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787548586.198882:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:6717:x1874380431828480:12345-0@lo:502: 00000100:00100000:3.0:1787548586.199588:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8829a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431828352:0@lo:8: 00000100:00100000:3.0:1787548586.199628:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.199987:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431828352 00000100:00100000:0.0:1787548586.199995:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431828352 00000100:00100000:0.0:1787548586.200030:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787548586.200149:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1874380431828352:12345-0@lo:8: 00010000:00080000:0.0:1787548586.200174:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1787548586.200209:0:6690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb7c48919424e6a4 00002000:00100000:0.0:1787548586.200245:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8fecace6e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787548586.200250:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787548586.200253:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787548586.200365:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787548586.200519:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787548586.200554:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8fecbcb62000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787548586.200666:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874380431828352:12345-0@lo:8: Request processed in 537us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548586.200674:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787548586.201192:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431828736:0@lo:400: 00000100:00100000:0.0:1787548586.201232:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.201259:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787548586.201265:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431828608:0@lo:400: 00000100:00100000:0.0:1787548586.201284:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548586.201474:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:6717:x1874380431828480:12345-0@lo:502: Request processed in 246us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548586.201487:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787548586.201551:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88299880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:6717:1874380431828480:0@lo:502: 00000020:01000000:1.0:1787548586.201582:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548586.201589:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548586.201591:0:6717:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787548586.201596:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787548586.201675:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787548586.201698:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787548586.201708:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e688 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.201720:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e688 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548586.201729:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787548586.201731:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fec8644c800 from 1 10000000:01000000:0.0:1787548586.201734:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787548586.201761:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.201782:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.201791:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548586.201807:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431828864:0@lo:101: 00000100:00100000:0.0:1787548586.201839:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.201860:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787548586.201961:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431828864 00000100:00100000:1.0:1787548586.201968:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431828864 00000100:00100000:1.0:1787548586.202215:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787548586.202226:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431828864:12345-0@lo:101: 00010000:00010000:1.0:1787548586.202237:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548586.202249:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec813f6c00/0xcb7c48919424e6b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e6ab expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548586.202270:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec813f6c00/0xcb7c48919424e6b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e6ab expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548586.202280:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec813f6c00/0xcb7c48919424e6b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e6ab expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548586.202290:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6c00, rc 0) 00000100:00100000:1.0:1787548586.202324:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431828864:12345-0@lo:101: Request processed in 101us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548586.202330:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1787548586.205205:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8fec8829a300 x1874380431828352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787548596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548586.205220:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787548586.205228:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787548586.205237:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787548586.205242:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787548586.205261:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fecad8a0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787548586.205287:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787548586.205293:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8829a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431828352:0@lo:8: 00000100:00100000:3.0:1787548586.205337:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431828736 00000100:00100000:3.0:1787548586.205343:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431828736 00000100:00100000:3.0:1787548586.205387:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431828608 00000100:00100000:3.0:1787548586.205391:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431828608 00000100:00100000:3.0:1787548586.205409:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787548586.205418:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431828736:12345-0@lo:400: 00000100:00100000:3.0:1787548586.205510:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431828736:12345-0@lo:400: Request processed in 93us (4278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548586.205517:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787548586.205532:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787548586.205538:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431828608:12345-0@lo:400: 00000100:00100000:3.0:1787548586.205566:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431828608:12345-0@lo:400: Request processed in 28us (4280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548586.205571:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787548586.205589:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787548586.205613:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fec88298a80 x1874380431828608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548586.205623:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431828608:0@lo:400: 00010000:00080000:3.0:1787548586.205633:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fec88298700 x1874380431828736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548586.205640:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431828736:0@lo:400: 00000004:00080000:3.0:1787548586.205658:0:6721:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787548586.205752:0:6721:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 209082620579ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787548586.205902:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431828864:0@lo:101: 00010000:00010000:1.0:1787548586.205922:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e6b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548586.205934:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e6b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548586.205993:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88299880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431828992:0@lo:501: 00000100:00100000:1.0:1787548586.206033:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548586.206099:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787548586.210923:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431828992 00000100:00100000:0.0:1787548586.210934:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431828992 00000100:00100000:0.0:1787548586.210977:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787548586.210986:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431828992:12345-0@lo:501: 00000100:00100000:0.0:1787548586.211255:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431828992:12345-0@lo:501: Request processed in 269us (5220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548586.211263:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787548586.211314:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88299880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431828992:0@lo:501: 00000100:00100000:0.0:1787548586.211362:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431829120:0@lo:503: 00000100:00100000:0.0:1787548586.211406:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.211444:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548586.211458:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431829120 00000100:00100000:0.0:1787548586.211462:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431829120 00000100:00100000:0.0:1787548586.211482:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787548586.211487:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431829120:12345-0@lo:503: 00000100:00100000:0.0:1787548586.211821:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431829120:12345-0@lo:503: Request processed in 332us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548586.211838:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787548586.211938:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431829120:0@lo:503: 00000100:00100000:1.0:1787548586.220082:0:6724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88298000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:6724:1874380431829248:0@lo:502: 00000100:00100000:1.0:1787548586.220170:0:6724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548586.220197:0:6724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787548586.221427:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431829248 00000100:00100000:0.0:1787548586.221449:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431829248 00000100:00100000:0.0:1787548586.221493:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787548586.221501:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+15:6724:x1874380431829248:12345-0@lo:502: 00000100:00100000:0.0:1787548586.221783:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+15:6724:x1874380431829248:12345-0@lo:502: Request processed in 282us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548586.221791:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787548586.221845:0:6724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88298000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:6724:1874380431829248:0@lo:502: 00000020:01000000:0.0:1787548586.221879:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787548586.221888:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548586.221891:0:6724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787548586.221899:0:6724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fec8644c800 00000020:00000080:0.0:1787548586.221901:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787548586.221931:0:6724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad281500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:6724:1874380431829376:0@lo:502: 00000100:00100000:0.0:1787548586.221969:0:6724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.221993:0:6724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a300 going to sleep for 11 seconds 00000100:00100000:0.0:1787548586.222006:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431829376 00000100:00100000:0.0:1787548586.222009:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431829376 00000100:00100000:0.0:1787548586.222029:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787548586.222035:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+15:6724:x1874380431829376:12345-0@lo:502: 00000100:00100000:0.0:1787548586.222172:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+15:6724:x1874380431829376:12345-0@lo:502: Request processed in 136us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548586.222178:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787548586.222211:0:6724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad281500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:6724:1874380431829376:0@lo:502: 00000020:01000000:0.0:1787548586.222233:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787548586.222237:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548586.222238:0:6724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787548586.222242:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787548586.222318:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787548586.222334:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787548586.222342:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e6b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.222353:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e6b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548586.222361:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787548586.222363:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fec87eab370 from 1 10000000:01000000:0.0:1787548586.222366:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787548586.222386:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.222394:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.222404:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548586.222417:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431829504:0@lo:101: 00000100:00100000:0.0:1787548586.222456:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.222475:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431829504 00000100:00100000:0.0:1787548586.222479:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431829504 00000100:00100000:0.0:1787548586.222505:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787548586.222511:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec900bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431829504:12345-0@lo:101: 00010000:00010000:0.0:1787548586.222527:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548586.222538:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec80031200/0xcb7c48919424e6c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e6b9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.222558:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec80031200/0xcb7c48919424e6c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e6b9 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.222566:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec80031200/0xcb7c48919424e6c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e6b9 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.222575:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec80031200, rc 0) 00000100:00100000:0.0:1787548586.223536:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec900bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431829504:12345-0@lo:101: Request processed in 1020us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548586.223543:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787548586.223577:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a300 going to sleep for 11 seconds 00000100:00100000:0.0:1787548586.223601:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431829504:0@lo:101: 00010000:00010000:0.0:1787548586.223614:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e6c0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548586.223624:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e6c0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548586.223994:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431829632:0@lo:501: 00000100:00100000:0.0:1787548586.224022:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.224052:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431829632 00000100:00100000:0.0:1787548586.224057:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431829632 00000100:00100000:0.0:1787548586.224084:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787548586.224092:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec900bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431829632:12345-0@lo:501: 00000100:00100000:1.0:1787548586.224210:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a300 going to sleep for 11 seconds 00000100:00100000:0.0:1787548586.224350:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec900bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431829632:12345-0@lo:501: Request processed in 258us (326us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787548586.224357:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787548586.224410:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431829632:0@lo:501: 10000000:01000000:1.0:1787548586.224449:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787548586.224455:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e6c0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548586.224464:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e6c0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787548586.249372:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787548586.249461:0:6723:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787548586.249466:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431829760:0@lo:13: 00000100:00100000:3.0:1787548586.249481:0:6723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6723:1874380431829888:0@lo:7: 00000100:00100000:3.0:1787548586.249693:0:6723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548586.249775:0:6723:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865fbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787548586.252418:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548586.253024:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431829888 00000100:00100000:2.0:1787548586.253034:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431829888 00000100:00080000:1.0:1787548586.253168:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787548586.253496:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787548586.253508:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6723:x1874380431829888:12345-0@lo:7: 00000100:00100000:1.0:1787548586.257365:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431829760 00000100:00100000:1.0:1787548586.257379:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431829760 00000100:00100000:1.0:1787548586.257445:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548586.257456:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1874380431829760:12345-0@lo:13: 00002000:00000024:1.0:1787548586.257485:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:1.0:1787548586.257598:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1874380431829760:12345-0@lo:13: Request processed in 131us (5173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548586.257606:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787548586.261369:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8feca71d8e00 x1874380431829760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548586.261393:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431829760:0@lo:13: 00002000:00080000:2.0:1787548586.267511:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787548586.267519:0:6692:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787548586.267610:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6723:x1874380431829888:12345-0@lo:7: Request processed in 14101us (17913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548586.267621:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787548586.268161:0:6723:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8feca71d8380 x1874380431829888/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787548602 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548586.268176:0:6723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6723:1874380431829888:0@lo:7: 00000004:00080000:0.0:1787548586.268189:0:6723:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787548586.268224:0:6723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6723:1874380431830016:0@lo:5: 00000100:00100000:0.0:1787548586.268266:0:6723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548586.268309:0:6723:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787548586.272289:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431830016 00000100:00100000:2.0:1787548586.272305:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431830016 00000100:00100000:2.0:1787548586.272364:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787548586.272375:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6723:x1874380431830016:12345-0@lo:5: 00002000:00080000:2.0:1787548586.272411:0:6690:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787548586.272415:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787548586.272791:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6723:x1874380431830016:12345-0@lo:5: Request processed in 417us (4523us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787548586.272799:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787548586.273265:0:6723:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8fecad283100 x1874380431830016/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787548602 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548586.273283:0:6723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6723:1874380431830016:0@lo:5: 00000004:00080000:3.0:1787548586.273294:0:6723:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787548586.273326:0:6723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6723:1874380431830144:0@lo:700: 00000100:00100000:3.0:1787548586.273359:0:6723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548586.273392:0:6723:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865fbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787548586.273554:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431830144 00000100:00100000:1.0:1787548586.273560:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431830144 00000100:00100000:1.0:1787548586.273600:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548586.273608:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6723:x1874380431830144:12345-0@lo:700: 00000100:00100000:1.0:1787548586.273636:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88299f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6698:1874380431830272:0@lo:700: 00000100:00100000:1.0:1787548586.273663:0:6698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548586.273686:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec900a9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787548586.273780:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431830272 00000100:00100000:3.0:1787548586.273784:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431830272 00000100:00100000:3.0:1787548586.273815:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787548586.273821:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec88299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6698:x1874380431830272:12345-0@lo:700: 40000000:02000000:2.0:1787548586.335041:0:5862:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787548586.347408:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec88299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6698:x1874380431830272:12345-0@lo:700: Request processed in 73577us (73734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548586.347428:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787548586.348503:0:6698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fec88299f80 x1874380431830272/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787548602 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548586.348520:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88299f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6698:1874380431830272:0@lo:700: 40000000:02000000:3.0:1787548586.348532:0:6698:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1787548586.429379:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6723:x1874380431830144:12345-0@lo:700: Request processed in 155764us (156012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548586.429397:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787548586.429542:0:6723:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8feca71dbb80 x1874380431830144/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787548602 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548586.429565:0:6723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6723:1874380431830144:0@lo:700: 00000001:00100000:0.0:1787548586.430217:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787548586.430235:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00010000:3.0:1787548586.438925:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:2.0:1787548586.501925:0:6723:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1787548586.507465:0:6723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6723:1874380431830400:0@lo:5: 00000100:00100000:2.0:1787548586.507538:0:6723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548586.507693:0:6723:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787548586.508015:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431830400 00000100:00100000:3.0:1787548586.508033:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431830400 00000100:00100000:3.0:1787548586.508125:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787548586.508152:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6723:x1874380431830400:12345-0@lo:5: 00002000:00080000:1.0:1787548586.527340:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787548586.527360:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787548586.532509:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6723:x1874380431830400:12345-0@lo:5: Request processed in 24350us (24961us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787548586.532526:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787548586.536107:0:6723:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecb3dbf800 x1874380431830400/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787548602 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548586.536127:0:6723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787548586.536171:0:6723:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8fecb3dbf800 x1874380431830400/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787548602 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548586.536183:0:6723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6723:1874380431830400:0@lo:5: 00000004:00080000:2.0:1787548586.536201:0:6723:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787548587.460252:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548588.484113:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548589.510736:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548590.532374:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548591.555813:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548591.619544:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431830528:0@lo:400: 00000100:00100000:0.0:1787548591.619787:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431830912:0@lo:400: 00000100:00100000:0.0:1787548591.619825:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548591.619900:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431830656:0@lo:400: 00000100:00100000:0.0:1787548591.619935:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548591.619953:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787548591.619959:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431830784:0@lo:400: 00000100:00100000:0.0:1787548591.619987:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548591.620038:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431830912 00000100:00100000:0.0:1787548591.620047:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431830912 00000100:00100000:0.0:1787548591.620100:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787548591.620112:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1874380431830912:12345-0@lo:400: 00000100:00100000:0.0:1787548591.620181:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1874380431830912:12345-0@lo:400: Request processed in 72us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548591.620187:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787548591.620211:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431830656 00000100:00100000:0.0:1787548591.620214:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431830656 00000100:00100000:0.0:1787548591.620234:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431830784 00000100:00100000:0.0:1787548591.620237:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431830784 00000100:00100000:0.0:1787548591.620251:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787548591.620260:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431830656:12345-0@lo:400: 00000100:00100000:3.0:1787548591.622471:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548591.622534:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431831040:0@lo:13: 00000100:00100000:3.0:1787548591.622582:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548591.622770:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431830528 00000100:00100000:2.0:1787548591.622776:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431830528 00000100:00100000:2.0:1787548591.622812:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787548591.622820:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+16:3316:x1874380431830528:12345-0@lo:400: 00000100:00100000:1.0:1787548591.622824:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431831040 00000100:00100000:1.0:1787548591.622827:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431831040 00000100:00100000:1.0:1787548591.622853:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548591.622859:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874380431831040:12345-0@lo:13: 00002000:00000024:1.0:1787548591.622881:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548591.623902:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431830656:12345-0@lo:400: Request processed in 3642us (3963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548591.623911:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787548591.623932:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787548591.623940:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431830784:12345-0@lo:400: 00000100:00100000:0.0:1787548591.623970:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431830784:12345-0@lo:400: Request processed in 33us (3982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548591.623974:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787548591.623992:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787548591.623996:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787548591.624454:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecb3dbc000 x1874380431830784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548591.624468:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431830784:0@lo:400: 00010000:00080000:3.0:1787548591.624478:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecb3dbc700 x1874380431830656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548591.624486:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431830656:0@lo:400: 00010000:00080000:0.0:1787548591.624803:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecb3dbdf80 x1874380431830912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548591.624814:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431830912:0@lo:400: 00000100:00100000:2.0:1787548591.624971:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+16:3316:x1874380431830528:12345-0@lo:400: Request processed in 2150us (2502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548591.624978:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787548591.626849:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431830528:0@lo:400: 00000100:00100000:1.0:1787548591.632497:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874380431831040:12345-0@lo:13: Request processed in 9630us (9906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548591.632512:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787548591.632592:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecb3dbd500 x1874380431831040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548591.632615:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431831040:0@lo:13: 00000001:00080000:3.0:1787548591.670721:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:0.0:1787548591.772534:0:7060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg613-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787548592.581490:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548593.604738:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548594.629173:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548595.651418:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548596.678762:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548596.741987:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431831168:0@lo:400: 00000100:00100000:1.0:1787548596.742056:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548596.742102:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787548596.742108:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431831296:0@lo:400: 00000100:00100000:1.0:1787548596.742150:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548596.742180:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431831424:0@lo:400: 00000100:00100000:1.0:1787548596.742203:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548596.742221:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787548596.742226:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431831552:0@lo:400: 00000100:00100000:1.0:1787548596.742249:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548596.742291:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431831168 00000100:00100000:1.0:1787548596.742298:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431831168 00000100:00100000:1.0:1787548596.742346:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787548596.742355:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+16:3313:x1874380431831168:12345-0@lo:400: 00000100:00100000:1.0:1787548596.742413:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+16:3313:x1874380431831168:12345-0@lo:400: Request processed in 58us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548596.742420:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787548596.742450:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431831296 00000100:00100000:1.0:1787548596.742454:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431831296 00000100:00100000:1.0:1787548596.742478:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431831424 00000100:00100000:1.0:1787548596.742480:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431831424 00000100:00100000:1.0:1787548596.742517:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787548596.742523:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec88298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431831296:12345-0@lo:400: 00000100:00100000:1.0:1787548596.743707:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec88298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431831296:12345-0@lo:400: Request processed in 1179us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548596.743718:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787548596.743740:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787548596.743748:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec88298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431831424:12345-0@lo:400: 00000100:00100000:1.0:1787548596.743788:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec88298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431831424:12345-0@lo:400: Request processed in 42us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548596.743794:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787548596.743821:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431831552 00000100:00100000:1.0:1787548596.743826:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431831552 00000100:00100000:1.0:1787548596.743862:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548596.743869:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431831552:12345-0@lo:400: 00000100:00100000:1.0:1787548596.743900:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431831552:12345-0@lo:400: Request processed in 32us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548596.743905:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787548596.743927:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787548596.743932:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787548596.744499:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fec88299880 x1874380431831552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548596.744510:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787548596.744525:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431831552:0@lo:400: 00010000:00080000:0.0:1787548596.744550:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fec88298000 x1874380431831424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548596.744558:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431831424:0@lo:400: 00010000:00080000:1.0:1787548596.744882:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fec88299f80 x1874380431831296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548596.744893:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431831296:0@lo:400: 00000100:00100000:1.0:1787548596.744904:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431831168:0@lo:400: 00000100:00100000:1.0:1787548596.749979:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787548596.750002:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431831680:0@lo:13: 00000100:00100000:1.0:1787548596.750407:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548596.750520:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431831680 00000100:00100000:0.0:1787548596.750528:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431831680 00000100:00100000:0.0:1787548596.751484:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787548596.751494:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec88299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431831680:12345-0@lo:13: 00002000:00000024:0.0:1787548596.751527:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548596.752769:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec88299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431831680:12345-0@lo:13: Request processed in 1272us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548596.752780:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787548596.757787:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecb3dbd180 x1874380431831680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548596.757814:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431831680:0@lo:13: 00010000:00010000:1.0:1787548597.699569:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548598.723294:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548599.751264:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548600.771730:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548601.800243:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548601.863980:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431831808:0@lo:13: 00000100:00100000:1.0:1787548601.864068:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548601.864161:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431832320:0@lo:400: 00000100:00100000:1.0:1787548601.864185:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548601.864213:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787548601.864219:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431832192:0@lo:400: 00000100:00100000:1.0:1787548601.864241:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548601.865027:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431831808 00000100:00100000:2.0:1787548601.865040:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431831808 00000100:00100000:2.0:1787548601.865107:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787548601.865118:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec88299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431831808:12345-0@lo:13: 00002000:00000024:2.0:1787548601.865174:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548601.865245:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec88299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431831808:12345-0@lo:13: Request processed in 129us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548601.865318:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787548601.865346:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787548601.865747:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecb3dbf100 x1874380431831808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548601.865770:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431831808:0@lo:13: 00000100:00100000:1.0:1787548601.865805:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431832064:0@lo:400: 00000100:00100000:1.0:1787548601.865838:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548601.865859:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787548601.865865:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431831936:0@lo:400: 00000100:00100000:1.0:1787548601.865891:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548601.866701:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431831936 00000100:00100000:2.0:1787548601.866711:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431831936 00000100:00100000:2.0:1787548601.866752:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787548601.866762:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+16:3316:x1874380431831936:12345-0@lo:400: 00000100:00100000:2.0:1787548601.866816:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+16:3316:x1874380431831936:12345-0@lo:400: Request processed in 56us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548601.866824:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787548601.867058:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431832320 00000100:00100000:0.0:1787548601.867064:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431832320 00000100:00100000:0.0:1787548601.867099:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787548601.867106:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431832320:12345-0@lo:400: 00000100:00100000:0.0:1787548601.867244:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431832320:12345-0@lo:400: Request processed in 139us (3057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548601.867251:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787548601.868041:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431831936:0@lo:400: 00000100:00100000:1.0:1787548601.868077:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431832192 00000100:00100000:1.0:1787548601.868081:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431832192 00000100:00100000:1.0:1787548601.868144:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431832064 00000100:00100000:1.0:1787548601.868156:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431832064 00000100:00100000:1.0:1787548601.868178:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787548601.868185:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec88299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431832192:12345-0@lo:400: 00000100:00100000:1.0:1787548601.868235:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec88299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431832192:12345-0@lo:400: Request processed in 50us (3992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548601.868242:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787548601.868267:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787548601.868274:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431832064:12345-0@lo:400: 00000100:00100000:1.0:1787548601.868306:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431832064:12345-0@lo:400: Request processed in 33us (2467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548601.868312:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787548601.868368:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecb3dbd180 x1874380431832064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548601.868383:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431832064:0@lo:400: 00000100:00080000:2.0:1787548601.869093:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787548601.869175:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecb3dbd500 x1874380431832320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548601.869190:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431832320:0@lo:400: 00010000:00080000:0.0:1787548601.869218:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecb3dbf800 x1874380431832192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548601.869227:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431832192:0@lo:400: 00010000:00010000:1.0:1787548602.821628:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787548603.701880:0:7630:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787548603.701885:0:7630:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787548603.702100:0:7630:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fec88445800 00000020:01000004:2.0:1787548603.702120:0:7630:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787548603.702206:0:7630:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787548603.702223:0:7630:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8fec86110000) 00000020:00000080:2.0:1787548603.702240:0:7630:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787548603.729431:0:7630:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787548603.729692:0:7630:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787548603.770852:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787548603.779106:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787548603.779183:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787548603.779251:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787548603.779280:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787548603.780195:0:7630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787548603.780210:0:7630:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787548603.780225:0:7630:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcb7c48919424e6ce 00000020:01000004:3.0:1787548603.780247:0:7630:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787548603.780275:0:7630:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787548603.780279:0:7630:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787548603.780286:0:7630:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787548603.780312:0:7630:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787548603.780317:0:7630:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787548603.799717:0:7630:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787548603.799768:0:7630:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.113@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787548603.799773:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787548603.799776:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787548603.799777:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787548603.799778:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787548603.799780:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787548603.799781:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787548603.799783:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787548603.799784:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787548603.799786:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787548603.799788:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787548603.799789:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787548603.799794:0:7630:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787548603.799796:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787548603.799798:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787548603.799799:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787548603.799962:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787548603.799963:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787548603.799965:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787548603.799966:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787548603.799967:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787548603.799968:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787548603.799969:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787548603.799971:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787548603.800017:0:7630:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787548603.800042:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431832448:0@lo:253: 00000100:00100000:3.0:1787548603.800249:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548603.800314:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9007b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787548603.800411:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431832448 00000100:00100000:1.0:1787548603.800421:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431832448 00000100:00100000:1.0:1787548603.800553:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787548603.800565:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+16:7630:x1874380431832448:12345-0@lo:253: 20000000:01000000:1.0:1787548603.800603:0:5846:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787548603.800608:0:5846:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787548603.800614:0:5846:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787548603.800618:0:5846:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787548603.802228:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787548603.802461:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787548603.802476:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787548603.802517:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787548603.802527:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787548603.802568:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787548603.802617:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787548603.803026:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787548603.803049:0:5846:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.113@tcp 20000000:01000000:1.0:1787548603.803052:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.113@tcp (null) (null) (null) 00000040:00080000:1.0:1787548603.803093:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787548603.803102:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787548603.803192:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787548603.803201:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.113@tcp (null) (null) 00000040:00080000:1.0:1787548603.803235:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787548603.803244:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787548603.803273:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787548603.803332:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787548603.805034:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787548603.805067:0:5846:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.113@tcp 20000000:01000000:1.0:1787548603.805069:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.113@tcp (null) (null) (null) 00000040:00080000:1.0:1787548603.805171:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787548603.805181:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787548603.805216:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787548603.805224:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.113@tcp (null) (null) 00000040:00080000:1.0:1787548603.805256:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787548603.805266:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787548603.805318:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787548603.805376:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787548603.805395:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787548603.805399:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787548603.805403:0:5846:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787548603.805418:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787548603.805421:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787548603.805463:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787548603.805466:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787548603.806571:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787548603.806683:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787548603.806721:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787548603.807472:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787548603.807524:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787548603.807577:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787548603.807590:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787548603.807593:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787548603.808451:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787548603.808525:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787548603.808585:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787548603.809078:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787548603.809121:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787548603.809260:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787548603.809274:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787548603.809277:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787548603.810638:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787548603.811274:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787548603.811329:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787548603.811420:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787548603.811434:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787548603.811436:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787548603.813486:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787548603.813576:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787548603.813645:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787548603.814247:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787548603.814289:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787548603.814339:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787548603.814369:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787548603.814372:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787548603.814383:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787548603.814408:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.814431:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec81534400/0xcb7c48919424e618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e611 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.814440:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fecc21ece00/0xcb7c48919424e642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e63b expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.814449:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e66c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e665 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.814456:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec80031800/0xcb7c48919424e688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e681 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.814469:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec80031200/0xcb7c48919424e6c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e6b9 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.814477:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.814523:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec80031200/0xcb7c48919424e6c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e6b9 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.814542:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fec80031200/0xcb7c48919424e6c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e6b9 expref: 16 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548603.814560:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8829aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5846:1874380431832576:0@lo:104: 00000100:00100000:1.0:1787548603.814646:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787548603.814716:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec80031800/0xcb7c48919424e688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e681 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.814726:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fec80031800/0xcb7c48919424e688 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e681 expref: 16 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548603.814734:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8829ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5846:1874380431832704:0@lo:104: 00000100:00100000:2.0:1787548603.814746:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1787548603.814763:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e66c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e665 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548603.814768:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787548603.814772:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e66c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e665 expref: 16 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548603.814780:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88298380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5846:1874380431832832:0@lo:104: 00000100:00100000:2.0:1787548603.814813:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431832576 00000100:00100000:1.0:1787548603.814813:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548603.814821:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431832576 00010000:00010000:1.0:1787548603.814857:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fecc21ece00/0xcb7c48919424e642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e63b expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548603.814863:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431832704 00000100:00100000:2.0:1787548603.814866:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431832704 00010000:00010000:1.0:1787548603.814866:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fecc21ece00/0xcb7c48919424e642 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e63b expref: 16 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548603.814875:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8829b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5846:1874380431832960:0@lo:104: 00000100:00100000:2.0:1787548603.814876:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431832832 00000100:00100000:2.0:1787548603.814889:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431832832 00000100:00100000:2.0:1787548603.815064:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787548603.815075:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec861fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+5:5846:x1874380431832576:12345-0@lo:104: 00010000:00010000:2.0:1787548603.815100:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e6c0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.815190:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787548603.815198:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec861fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+5:5846:x1874380431832576:12345-0@lo:104: Request processed in 125us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548603.815206:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787548603.815252:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787548603.815259:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+4:5846:x1874380431832704:12345-0@lo:104: 00010000:00010000:2.0:1787548603.815266:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e688 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.815305:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787548603.815310:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+4:5846:x1874380431832704:12345-0@lo:104: Request processed in 53us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548603.815316:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787548603.815329:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787548603.815334:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+3:5846:x1874380431832832:12345-0@lo:104: 00010000:00010000:2.0:1787548603.815341:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e66c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.815380:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787548603.815385:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+3:5846:x1874380431832832:12345-0@lo:104: Request processed in 51us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548603.815391:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1787548603.816010:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787548603.816019:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e6c0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816029:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec80031000 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:3.0:1787548603.816033:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e6c0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816043:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e6c0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787548603.816051:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e6c0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548603.816057:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787548603.816091:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e6c0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816098:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787548603.816118:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e6c0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816125:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec80031000/0xcb7c48919424e6b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e6c0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816167:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787548603.816171:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e688 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816177:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec80031600 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:3.0:1787548603.816180:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e688 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816187:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e688 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787548603.816193:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e688 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548603.816202:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787548603.816215:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e688 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816221:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787548603.816226:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e688 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816232:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec80031600/0xcb7c48919424e681 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e688 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816241:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548603.816244:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e66c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816258:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec80031e00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:3.0:1787548603.816261:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e66c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816268:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e66c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787548603.816274:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e66c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548603.816279:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787548603.816288:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e66c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816293:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787548603.816305:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e66c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816311:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec80031e00/0xcb7c48919424e665 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e66c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.816320:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548603.816321:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548603.816323:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548603.816425:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431833088:0@lo:103: 00000100:00100000:0.0:1787548603.816472:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548603.816518:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787548603.816523:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431833216:0@lo:103: 00000100:00100000:0.0:1787548603.816539:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548603.816559:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787548603.816565:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431833344:0@lo:103: 00000100:00100000:0.0:1787548603.816584:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548603.816610:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431833088 00000100:00100000:0.0:1787548603.816615:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431833088 00010000:00010000:0.0:1787548603.816640:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec80031200/0xcb7c48919424e6c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e6b9 expref: 17 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548603.816657:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431833216 00000100:00100000:0.0:1787548603.816659:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431833216 00010000:00010000:0.0:1787548603.816667:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec80031800/0xcb7c48919424e688 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e681 expref: 18 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548603.816676:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431833344 00000100:00100000:0.0:1787548603.816678:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431833344 00010000:00010000:0.0:1787548603.816685:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e66c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e665 expref: 19 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548603.816712:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787548603.816720:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad280a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431833088:12345-0@lo:103: 00010000:00010000:0.0:1787548603.816732:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548603.816738:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec80031200/0xcb7c48919424e6c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e6b9 expref: 19 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.816750:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec80031200/0xcb7c48919424e6c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e6b9 expref: 19 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.816769:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548603.816797:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad280a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431833088:12345-0@lo:103: Request processed in 78us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548603.816804:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787548603.816818:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787548603.816824:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad281880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:3315:x1874380431833216:12345-0@lo:103: 00010000:00010000:0.0:1787548603.816831:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548603.816835:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec80031800/0xcb7c48919424e688 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e681 expref: 18 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.816844:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec80031800/0xcb7c48919424e688 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e681 expref: 18 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.816855:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548603.816877:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad281880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:3315:x1874380431833216:12345-0@lo:103: Request processed in 53us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548603.816883:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787548603.817019:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787548603.817032:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad282300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:3314:x1874380431833344:12345-0@lo:103: 00010000:00010000:0.0:1787548603.817040:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548603.817044:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e66c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e665 expref: 17 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.817053:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e66c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e665 expref: 17 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.817063:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548603.817097:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad282300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:3314:x1874380431833344:12345-0@lo:103: Request processed in 66us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548603.817103:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787548603.817165:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431833216:0@lo:103: 00000100:00100000:0.0:1787548603.817174:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431833088:0@lo:103: 00000100:00100000:3.0:1787548603.817575:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431833344:0@lo:103: 00010000:00010000:1.0:1787548603.817642:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548603.817672:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787548603.818107:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec81534400/0xcb7c48919424e618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e611 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.818120:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fec81534400/0xcb7c48919424e618 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e611 expref: 16 pid: 5849 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548603.818146:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88299880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5846:1874380431833472:0@lo:104: 00000100:00100000:1.0:1787548603.818204:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548603.821666:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec87e5c300 going to sleep for 11 seconds 00010000:00010000:1.0:1787548603.821718:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec80031200/0xcb7c48919424e6c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e6b9 expref: 16 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548603.821743:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8829aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5846:1874380431832576:0@lo:104: 00010000:00010000:1.0:1787548603.821759:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec80031800/0xcb7c48919424e688 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e681 expref: 15 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548603.821767:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8829ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5846:1874380431832704:0@lo:104: 00010000:00010000:1.0:1787548603.821777:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e66c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e665 expref: 14 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548603.821787:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88298380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5846:1874380431832832:0@lo:104: 00000100:00100000:0.0:1787548603.821950:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431832960 00000100:00100000:0.0:1787548603.821962:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431832960 00000100:00100000:0.0:1787548603.822023:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431833472 00000100:00100000:0.0:1787548603.822028:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431833472 00000100:00100000:0.0:1787548603.822047:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787548603.822057:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec88298000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+4:5846:x1874380431832960:12345-0@lo:104: 00010000:00010000:0.0:1787548603.822076:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e642 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.822208:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787548603.822216:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec88298000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+4:5846:x1874380431832960:12345-0@lo:104: Request processed in 159us (4542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548603.822223:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787548603.822242:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787548603.822260:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:5846:x1874380431833472:12345-0@lo:104: 00010000:00010000:0.0:1787548603.822270:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e618 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.822301:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548603.822323:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787548603.822456:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:5846:x1874380431833472:12345-0@lo:104: Request processed in 197us (4251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548603.822462:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787548603.824245:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e642 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.824282:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec81535c00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:2.0:1787548603.824287:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e642 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.824299:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e642 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787548603.824307:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e642 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548603.824314:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787548603.825065:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8829b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5846:1874380431832960:0@lo:104: 00000100:00100000:0.0:1787548603.825079:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88299880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5846:1874380431833472:0@lo:104: 00010000:00010000:0.0:1787548603.825121:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.825346:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e642 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.825364:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787548603.825390:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e642 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.825397:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec81535c00/0xcb7c48919424e63b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e642 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.825415:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548603.825419:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e618 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.825425:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec800 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:2.0:1787548603.825428:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e618 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.825451:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e618 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787548603.825457:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e618 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548603.825463:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787548603.825477:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e611 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e618 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.825483:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787548603.825501:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e611 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e618 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.825508:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e611 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e618 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.825524:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548603.825526:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548603.825528:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548603.825546:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431833600:0@lo:103: 00010000:00010000:1.0:1787548603.826702:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548603.826724:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787548603.826745:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431833728:0@lo:103: 00000100:00100000:1.0:1787548603.826802:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548603.829305:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431833728 00000100:00100000:0.0:1787548603.829323:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431833728 00010000:00010000:0.0:1787548603.829390:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec81534400/0xcb7c48919424e618 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e611 expref: 14 pid: 5849 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548603.829435:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787548603.829446:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:3316:x1874380431833728:12345-0@lo:103: 00010000:00010000:0.0:1787548603.829463:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548603.829470:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec81534400/0xcb7c48919424e618 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e611 expref: 14 pid: 5849 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.829485:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec81534400/0xcb7c48919424e618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e611 expref: 14 pid: 5849 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.829505:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec81534400/0xcb7c48919424e618 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e611 expref: 14 pid: 5849 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.829540:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548603.834185:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+13:3316:x1874380431833728:12345-0@lo:103: Request processed in 4725us (7367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548603.834205:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787548603.834399:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431833728:0@lo:103: 00000100:00100000:2.0:1787548603.834688:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548603.834778:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431833600 00000100:00100000:3.0:1787548603.834788:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431833600 00010000:00010000:3.0:1787548603.835000:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fecc21ece00/0xcb7c48919424e642 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e63b expref: 13 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548603.835063:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787548603.835073:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+13:3314:x1874380431833600:12345-0@lo:103: 00010000:00010000:3.0:1787548603.835090:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548603.835096:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fecc21ece00/0xcb7c48919424e642 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e63b expref: 13 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.835109:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fecc21ece00/0xcb7c48919424e642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e63b expref: 13 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.835160:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21ece00/0xcb7c48919424e642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e63b expref: 13 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.835181:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.835191:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.835211:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.835218:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.835226:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.835233:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.835249:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6200 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548603.835254:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.835263:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.835281:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.835292:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548603.835343:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:3314:x1874380431833600:12345-0@lo:103: Request processed in 271us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548603.835360:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787548603.835441:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.835451:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.835457:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec813f6200/0xcb7c48919424e6d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787548603.835472:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787548603.835623:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431833600:0@lo:103: 00010000:00010000:3.0:1787548603.863332:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548603.942796:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+11:7630:x1874380431832448:12345-0@lo:253: Request processed in 142225us (142539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548603.942811:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787548603.942917:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431832448:0@lo:253: 10000000:01000000:2.0:1787548603.942931:0:7630:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787548603.942934:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787548603.942936:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787548603.942938:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787548603.942951:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787548603.942953:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787548603.942954:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787548603.942956:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787548603.942957:0:7630:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787548603.942959:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787548603.942960:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787548603.942979:0:7630:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fec88445800 from lustre-OST0001 10000000:01000000:2.0:1787548603.943004:0:7630:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787548603.943007:0:7630:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787548603.943015:0:7630:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fec87eab370 local copy 10000000:01000000:2.0:1787548603.943019:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787548603.943053:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.943064:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.943086:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548603.943331:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431833856:0@lo:101: 00000100:00100000:2.0:1787548603.943377:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548603.943424:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecbca32300 going to sleep for 11 seconds 00000100:00100000:3.0:1787548603.943488:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431833856 00000100:00100000:3.0:1787548603.943494:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431833856 00000100:00100000:3.0:1787548603.943595:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787548603.943604:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+11:7630:x1874380431833856:12345-0@lo:101: 00010000:00010000:3.0:1787548603.943616:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548603.943628:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec81534600/0xcb7c48919424e6e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e6dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.943651:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec81534600/0xcb7c48919424e6e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e6dc expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.943674:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec81534600/0xcb7c48919424e6e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e6dc expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.943683:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec81534600, rc 0) 00000100:00100000:3.0:1787548603.943716:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:7630:x1874380431833856:12345-0@lo:101: Request processed in 112us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548603.943722:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787548603.943854:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431833856:0@lo:101: 00010000:00010000:0.0:1787548603.943868:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcb7c48919424e6e3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.943877:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcb7c48919424e6e3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548603.943974:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431833984:0@lo:501: 00000100:00100000:0.0:1787548603.944002:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548603.944027:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9070ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787548603.944370:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431833984 00000100:00100000:3.0:1787548603.944375:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431833984 00000100:00100000:3.0:1787548603.944442:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787548603.944449:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:7630:x1874380431833984:12345-0@lo:501: 00000100:00100000:3.0:1787548603.944663:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:7630:x1874380431833984:12345-0@lo:501: Request processed in 214us (659us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787548603.944671:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787548603.944732:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431833984:0@lo:501: 10000000:01000000:0.0:1787548603.944745:0:7630:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787548603.944772:0:7630:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787548603.944777:0:7630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcb7c48919424e6e3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.944786:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcb7c48919424e6e3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.944793:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcb7c48919424e6e3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.944822:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787548603.944842:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fec88445800 10000000:01000000:0.0:1787548603.944847:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787548603.944851:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787548603.944853:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787548603.944857:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787548603.944860:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787548603.944876:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.944885:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.944893:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548603.944906:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431834112:0@lo:101: 00000100:00100000:0.0:1787548603.944935:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787548603.947603:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548603.947615:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcb7c48919424e6e3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.947625:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec800 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:1.0:1787548603.947630:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcb7c48919424e6e3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.947640:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcb7c48919424e6e3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548603.947648:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcb7c48919424e6e3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548603.947654:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787548603.947702:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcb7c48919424e6e3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.947709:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548603.947733:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcb7c48919424e6e3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.947740:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e6dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcb7c48919424e6e3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.947755:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548603.947757:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548603.947758:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548603.947773:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431834240:0@lo:103: 00000100:00100000:1.0:1787548603.947828:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548603.947882:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431834240 00000100:00100000:1.0:1787548603.947888:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431834240 00000100:00100000:1.0:1787548603.947934:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548603.947943:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:3316:x1874380431834240:12345-0@lo:103: 00010000:00010000:1.0:1787548603.947954:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548603.947967:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec81534600/0xcb7c48919424e6e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424e6dc expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.947981:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548603.948012:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+11:3316:x1874380431834240:12345-0@lo:103: Request processed in 70us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548603.948019:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548603.948050:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431834240:0@lo:103: 00000100:00100000:0.0:1787548603.949880:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9070a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787548603.949991:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431834112 00000100:00100000:2.0:1787548603.949998:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431834112 00000100:00100000:2.0:1787548603.950059:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787548603.950077:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+11:7630:x1874380431834112:12345-0@lo:101: 00010000:00010000:2.0:1787548603.950092:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548603.950116:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e6f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e6ea expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.950156:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e6ea expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.950179:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e6ea expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.950187:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ed200, rc 0) 00000100:00100000:2.0:1787548603.950249:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:7630:x1874380431834112:12345-0@lo:101: Request processed in 183us (5313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548603.950255:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787548603.950429:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431834112:0@lo:101: 00010000:00010000:0.0:1787548603.950444:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e6f1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.950453:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e6f1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548603.950567:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431834368:0@lo:501: 00000100:00100000:0.0:1787548603.950607:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548603.950637:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9070a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787548603.950795:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431834368 00000100:00100000:2.0:1787548603.950800:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431834368 00000100:00100000:2.0:1787548603.950818:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787548603.950824:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:7630:x1874380431834368:12345-0@lo:501: 00000100:00100000:2.0:1787548603.951032:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:7630:x1874380431834368:12345-0@lo:501: Request processed in 207us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548603.951039:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787548603.951383:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431834368:0@lo:501: 00000100:00100000:0.0:1787548603.951412:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431834496:0@lo:503: 00000100:00100000:0.0:1787548603.951452:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548603.951481:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9070a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787548603.951604:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431834496 00000100:00100000:2.0:1787548603.951609:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431834496 00000100:00100000:2.0:1787548603.951630:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787548603.951636:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:7630:x1874380431834496:12345-0@lo:503: 00000100:00100000:2.0:1787548603.951800:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:7630:x1874380431834496:12345-0@lo:503: Request processed in 163us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548603.951808:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787548603.951889:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431834496:0@lo:503: 00000040:00080000:0.0:1787548603.952449:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787548603.952596:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431834624:0@lo:502: 00000100:00100000:0.0:1787548603.952712:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548603.952747:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9070a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787548603.952991:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431834624 00000100:00100000:2.0:1787548603.952996:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431834624 00000100:00100000:2.0:1787548603.953022:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787548603.953030:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:7630:x1874380431834624:12345-0@lo:502: 00000100:00100000:2.0:1787548603.953571:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:7630:x1874380431834624:12345-0@lo:502: Request processed in 468us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548603.953587:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787548603.953651:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431834624:0@lo:502: 00000040:00080000:2.0:1787548603.954425:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787548603.954481:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787548603.954598:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787548603.954652:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787548603.954691:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787548603.954727:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787548603.954762:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431834752:0@lo:502: 00000100:00100000:2.0:1787548603.954815:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548603.954898:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecbca32600 going to sleep for 11 seconds 00000100:00100000:3.0:1787548603.954942:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431834752 00000100:00100000:3.0:1787548603.954949:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431834752 00000100:00100000:3.0:1787548603.955019:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787548603.955473:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:7630:x1874380431834752:12345-0@lo:502: 00000100:00100000:3.0:1787548603.955762:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:7630:x1874380431834752:12345-0@lo:502: Request processed in 734us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548603.955770:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787548603.955938:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431834752:0@lo:502: 00000040:00080000:0.0:1787548603.956057:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787548603.956082:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787548603.957735:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787548603.957751:0:7638:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787548603.957758:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548603.957760:0:7638:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787548603.957765:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787548603.957778:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8feb811e8000) 00000020:00000080:1.0:1787548603.957797:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787548603.957802:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787548603.957856:0:7638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fec88445800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787548603.957864:0:7638:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787548603.957871:0:7638:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcb7c48919424e6ff 00010000:00010000:3.0:1787548603.962818:0:7638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787548603.963342:0:7638:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787548603.965891:0:7638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787548603.966849:0:7638:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787548603.970803:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787548603.971638:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787548603.973188:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787548603.973198:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787548603.973211:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548603.973214:0:7638:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787548603.973217:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787548603.973221:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548603.973223:0:7638:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787548603.973225:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787548603.973227:0:7638:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787548603.973271:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787548603.973275:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548603.973276:0:7638:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787548603.973279:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787548603.973491:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787548603.973525:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787548603.973559:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e6f1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.973570:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e6f1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548603.973578:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fec88445800 from 1 10000000:01000000:2.0:1787548603.973581:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787548603.973611:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.973618:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.973628:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548603.973647:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431834880:0@lo:101: 00000100:00100000:2.0:1787548603.973710:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548603.973750:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecbca32600 going to sleep for 11 seconds 00000100:00100000:0.0:1787548603.973859:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431834880 00000100:00100000:0.0:1787548603.973866:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431834880 00000100:00100000:0.0:1787548603.973908:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787548603.973916:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+12:7630:x1874380431834880:12345-0@lo:101: 00010000:00010000:0.0:1787548603.973928:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548603.973939:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90151c00/0xcb7c48919424e70d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e706 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.973959:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90151c00/0xcb7c48919424e70d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e706 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.973969:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90151c00/0xcb7c48919424e70d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e706 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548603.973978:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151c00, rc 0) 00000100:00100000:0.0:1787548603.974019:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+13:7630:x1874380431834880:12345-0@lo:101: Request processed in 103us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548603.974025:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787548603.974174:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431834880:0@lo:101: 00010000:00010000:2.0:1787548603.974187:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e70d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548603.974196:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e70d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548603.974422:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835008:0@lo:501: 00000100:00100000:2.0:1787548603.974447:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548603.974473:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecbca32600 going to sleep for 11 seconds 00000100:00100000:3.0:1787548603.974567:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431835008 00000100:00100000:3.0:1787548603.974571:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431835008 00000100:00100000:3.0:1787548603.974603:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787548603.974610:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+13:7630:x1874380431835008:12345-0@lo:501: 00000100:00100000:3.0:1787548603.974829:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+13:7630:x1874380431835008:12345-0@lo:501: Request processed in 218us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548603.974836:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787548603.974926:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835008:0@lo:501: 00000100:00100000:2.0:1787548603.974952:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835136:0@lo:503: 00000100:00100000:2.0:1787548603.974989:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548603.975010:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecbca32600 going to sleep for 11 seconds 00000100:00100000:3.0:1787548603.975340:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431835136 00000100:00100000:3.0:1787548603.975345:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431835136 00000100:00100000:3.0:1787548603.975383:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787548603.975389:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+13:7630:x1874380431835136:12345-0@lo:503: 00000100:00100000:3.0:1787548603.975857:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+13:7630:x1874380431835136:12345-0@lo:503: Request processed in 467us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548603.975865:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787548603.977244:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835136:0@lo:503: 00000040:00080000:0.0:1787548603.977884:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787548603.977971:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835264:0@lo:502: 00000100:00100000:0.0:1787548603.978046:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548603.978126:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431835264 00000100:00100000:3.0:1787548603.978149:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431835264 00000100:00100000:3.0:1787548603.978188:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787548603.978196:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+13:7630:x1874380431835264:12345-0@lo:502: 00000100:00100000:0.0:1787548603.978234:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9070a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787548603.978419:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+13:7630:x1874380431835264:12345-0@lo:502: Request processed in 223us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548603.978426:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787548603.978614:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835264:0@lo:502: 00000040:00080000:0.0:1787548603.978949:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787548603.979017:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787548603.979043:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835392:0@lo:502: 00000100:00100000:0.0:1787548603.979081:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548603.979123:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9070a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787548603.979388:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431835392 00000100:00100000:3.0:1787548603.979394:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431835392 00000100:00100000:3.0:1787548603.979429:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787548603.979437:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+13:7630:x1874380431835392:12345-0@lo:502: 00000100:00100000:3.0:1787548603.979671:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+13:7630:x1874380431835392:12345-0@lo:502: Request processed in 233us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548603.979685:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787548603.979723:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835392:0@lo:502: 00000040:00080000:3.0:1787548603.979815:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787548603.979826:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787548603.981775:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787548603.981787:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548603.981790:0:7642:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787548603.981798:0:7642:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fec88445800 00000020:00000080:3.0:1787548603.981800:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787548603.981825:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787548603.981830:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548603.981832:0:7642:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787548603.981835:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787548603.981990:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787548603.982020:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787548603.982157:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e70d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.982170:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e70d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548603.982228:0:7630:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787548603.982231:0:7630:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fec88445800 10000000:01000000:1.0:1787548603.982233:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fec88445800 10000000:01000000:1.0:1787548603.982238:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787548603.982243:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fec88445800 from 1 10000000:01000000:1.0:1787548603.982246:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787548603.982278:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.982286:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548603.982296:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548603.982326:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835520:0@lo:101: 00000100:00100000:1.0:1787548603.982744:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548603.982813:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec861f6000 going to sleep for 11 seconds 00000100:00100000:3.0:1787548603.982851:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431835520 00000100:00100000:3.0:1787548603.982859:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431835520 00000100:00100000:3.0:1787548603.982937:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787548603.982947:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+13:7630:x1874380431835520:12345-0@lo:101: 00010000:00010000:3.0:1787548603.982959:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548603.982971:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec81534800/0xcb7c48919424e71b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e714 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.982991:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec81534800/0xcb7c48919424e71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e714 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.983002:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec81534800/0xcb7c48919424e71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e714 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.983011:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec81534800, rc 0) 00000100:00100000:3.0:1787548603.983052:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:7630:x1874380431835520:12345-0@lo:101: Request processed in 107us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548603.983066:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787548603.983299:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835520:0@lo:101: 00010000:00010000:3.0:1787548603.983313:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e71b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548603.983322:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e71b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548603.983644:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835648:0@lo:501: 00000100:00100000:3.0:1787548603.983675:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548603.983741:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8950f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548603.983780:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431835648 00000100:00100000:2.0:1787548603.983786:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431835648 00000100:00100000:2.0:1787548603.983822:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787548603.983831:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:7630:x1874380431835648:12345-0@lo:501: 00000100:00100000:2.0:1787548603.984209:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:7630:x1874380431835648:12345-0@lo:501: Request processed in 378us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548603.984217:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787548603.984715:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835648:0@lo:501: 00000100:00100000:3.0:1787548603.984752:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835776:0@lo:503: 00000100:00100000:3.0:1787548603.984803:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548603.984840:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8950f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548603.984871:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431835776 00000100:00100000:2.0:1787548603.984877:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431835776 00000100:00100000:2.0:1787548603.984904:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787548603.984912:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:7630:x1874380431835776:12345-0@lo:503: 00000100:00100000:2.0:1787548603.985155:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:7630:x1874380431835776:12345-0@lo:503: Request processed in 161us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548603.985162:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787548603.985290:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835776:0@lo:503: 00000040:00080000:3.0:1787548603.985799:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787548603.985856:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835904:0@lo:502: 00000100:00100000:3.0:1787548603.985895:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548603.985974:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8950f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548603.986011:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431835904 00000100:00100000:2.0:1787548603.986016:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431835904 00000100:00100000:2.0:1787548603.986086:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787548603.986095:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:7630:x1874380431835904:12345-0@lo:502: 00000100:00100000:2.0:1787548603.986325:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:7630:x1874380431835904:12345-0@lo:502: Request processed in 231us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548603.986332:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787548603.986600:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431835904:0@lo:502: 00000040:00080000:1.0:1787548603.986852:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787548603.987174:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787548603.987377:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787548603.987548:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787548603.987593:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787548603.987647:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787548603.987686:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787548603.987723:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787548603.987773:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787548603.987832:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787548603.987869:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787548603.987918:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787548603.987955:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787548603.987990:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787548603.988055:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787548603.988109:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787548603.988218:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787548603.988274:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787548603.988312:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787548603.988358:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787548603.988411:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787548603.989247:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787548603.989303:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787548603.989387:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787548603.989600:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787548603.989654:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787548603.989709:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787548603.989750:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787548603.989799:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787548603.989862:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787548603.989901:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787548603.989940:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787548603.989983:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787548603.990047:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787548603.990965:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787548603.991041:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787548603.991209:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787548603.991259:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431836032:0@lo:502: 00000100:00100000:2.0:1787548603.991356:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548603.991401:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431836032 00000100:00100000:2.0:1787548603.991402:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecbca326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548603.991409:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431836032 00000100:00100000:1.0:1787548603.992088:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787548603.992110:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+14:7630:x1874380431836032:12345-0@lo:502: 00000100:00100000:1.0:1787548603.992373:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+14:7630:x1874380431836032:12345-0@lo:502: Request processed in 276us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548603.992382:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787548603.992776:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431836032:0@lo:502: 00000040:00080000:2.0:1787548603.992858:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787548603.992869:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787548603.995587:0:7643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787548603.995618:0:7643:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8feb81f399b8) 00000020:00000080:3.0:1787548603.995640:0:7643:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787548603.995708:0:7643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fec88445800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787548603.995712:0:7643:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fec88445800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787548603.995715:0:7643:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fec88445800 3 00010000:00080000:3.0:1787548603.995753:0:7643:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8feb81f24800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.113@tcp at head 00010000:00010000:3.0:1787548603.997277:0:7643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787548603.997463:0:7643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787548603.997492:0:7643:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787548603.997502:0:7643:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcb7c48919424e729 00000100:00080000:3.0:1787548603.997511:0:7643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787548603.997516:0:7643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8feb81f24800 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:3.0:1787548603.997547:0:7643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8feca71d8380 x1874380431836160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787548603.997585:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1874380431836160:0@lo:38: 00000100:00100000:3.0:1787548603.997646:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548603.997701:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431836160 00000100:00100000:3.0:1787548603.997708:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431836160 00000100:00100000:3.0:1787548603.997750:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787548603.997757:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874380431836160:12345-0@lo:38: 00010000:00080000:3.0:1787548603.997777:0:5854:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:3.0:1787548603.997802:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcb7c48919424e730 00000004:00100000:3.0:1787548603.997816:0:5854:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787548603.997842:0:5854:0:(import.c:65:import_set_state_nolock()) ffff8fecacdea800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787548603.997888:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874380431836160:12345-0@lo:38: Request processed in 130us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548603.997896:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787548603.997931:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8feca71d8380 x1874380431836160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787548613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548603.997942:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787548603.997948:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787548603.997954:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787548603.997963:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787548603.997965:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8feb81f24800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787548603.997971:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1874380431836160:0@lo:38: 00000100:00080000:3.0:1787548603.997987:0:7643:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787548603.998057:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431836288:0@lo:400: 00000100:00100000:3.0:1787548603.998084:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548603.998104:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787548603.998110:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431836416:0@lo:400: 00000100:00100000:3.0:1787548603.998159:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548603.998191:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431836544:0@lo:400: 00000100:00100000:3.0:1787548603.998216:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548604.001425:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431836288 00000100:00100000:2.0:1787548604.001440:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431836288 00000100:00100000:2.0:1787548604.001486:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431836416 00000100:00100000:2.0:1787548604.001489:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431836416 00000100:00100000:2.0:1787548604.001518:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787548604.001527:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431836288:12345-0@lo:400: 00000100:00100000:2.0:1787548604.001625:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431836288:12345-0@lo:400: Request processed in 98us (3538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548604.001633:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787548604.001657:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787548604.001664:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431836416:12345-0@lo:400: 00000100:00100000:2.0:1787548604.001696:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431836416:12345-0@lo:400: Request processed in 33us (3565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548604.001701:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1787548604.001718:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787548604.002383:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8feca71d9500 x1874380431836416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548604.002399:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431836416:0@lo:400: 00010000:00080000:3.0:1787548604.002412:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8feca71d8380 x1874380431836288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548604.002420:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431836288:0@lo:400: 00000040:00080000:2.0:1787548604.002699:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1787548604.002795:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787548604.002818:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787548604.002838:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e71b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.002849:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e71b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787548604.002894:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787548604.002897:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787548604.002898:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787548604.002899:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787548604.002900:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787548604.002902:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787548604.002903:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787548604.002905:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787548604.002906:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787548604.002907:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787548604.002909:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787548604.002913:0:7630:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787548604.002915:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787548604.002916:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787548604.002917:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787548604.002918:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787548604.002919:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787548604.002920:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787548604.002921:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787548604.002926:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787548604.002927:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787548604.002928:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787548604.002929:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787548604.002960:0:7630:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787548604.002975:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431836672:0@lo:253: 00000100:00100000:2.0:1787548604.003025:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548604.003053:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431836672 00000100:00100000:2.0:1787548604.003059:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431836672 00000100:00100000:2.0:1787548604.003106:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787548604.003114:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:7630:x1874380431836672:12345-0@lo:253: 20000000:01000000:2.0:1787548604.003159:0:5846:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787548604.003172:0:5846:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787548604.003734:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec88754300 going to sleep for 11 seconds 00000100:00100000:3.0:1787548604.004023:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7645:1874380431836800:0@lo:901: 00000100:00100000:3.0:1787548604.004066:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548604.004165:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787548604.004189:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431836544 00000100:00100000:0.0:1787548604.004197:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431836544 00000100:00100000:1.0:1787548604.004209:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431836800 00000100:00100000:1.0:1787548604.004216:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431836800 00000100:00100000:1.0:1787548604.004256:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548604.004264:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1874380431836800:12345-0@lo:901: 00000100:00080000:3.0:1787548604.004357:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787548604.004362:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787548604.004676:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787548604.004686:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431836544:12345-0@lo:400: 00000100:00100000:0.0:1787548604.004748:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431836544:12345-0@lo:400: Request processed in 64us (6530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548604.004755:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787548604.004803:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1874380431836800:12345-0@lo:901: Request processed in 538us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548604.004811:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787548604.004903:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8feca71db100 x1874380431836544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548604.004917:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431836544:0@lo:400: 00010000:00080000:3.0:1787548604.004972:0:7645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8feca71d8380 x1874380431836800/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787548620 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548604.004981:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7645:1874380431836800:0@lo:901: 20000000:01000000:2.0:1787548604.079774:0:5846:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787548604.079798:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787548604.080082:0:5871:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787548604.080087:0:5871:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787548604.080111:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548604.080153:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec813f6a00/0xcb7c48919424e67a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e673 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548604.080163:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548604.080281:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec813f6a00/0xcb7c48919424e67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e673 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548604.080384:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fec813f6a00/0xcb7c48919424e67a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e673 expref: 14 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548604.080400:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5871:1874380431836928:0@lo:104: 00000100:00100000:0.0:1787548604.080475:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548604.080530:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431836928 00000100:00100000:1.0:1787548604.080545:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431836928 00000100:00100000:1.0:1787548604.080617:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787548604.080629:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad283800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:5871:x1874380431836928:12345-0@lo:104: 00010000:00010000:1.0:1787548604.080649:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e67a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548604.080926:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787548604.080933:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad283800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:5871:x1874380431836928:12345-0@lo:104: Request processed in 307us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548604.080941:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787548604.081026:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9070a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548604.081053:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5871:1874380431836928:0@lo:104: 00010000:00010000:2.0:1787548604.081077:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548604.081082:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081086:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e67a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081105:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec80030a00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:2.0:1787548604.081111:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e67a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081121:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e67a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787548604.081153:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e67a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548604.081160:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787548604.081202:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e67a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081220:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787548604.081252:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e67a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081258:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e673 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e67a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081276:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548604.081278:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548604.081280:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548604.081418:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431837056:0@lo:103: 00000100:00100000:2.0:1787548604.081464:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548604.081521:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431837056 00000100:00100000:2.0:1787548604.081528:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431837056 00010000:00010000:2.0:1787548604.081565:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec813f6a00/0xcb7c48919424e67a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e673 expref: 15 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548604.081595:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787548604.081605:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3418829f-2e19-44b5-ae62-1256ac42dc62+15:3316:x1874380431837056:12345-0@lo:103: 00010000:00010000:2.0:1787548604.081617:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548604.081623:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec813f6a00/0xcb7c48919424e67a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e673 expref: 15 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081634:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec813f6a00/0xcb7c48919424e67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e673 expref: 15 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081650:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec813f6a00/0xcb7c48919424e67a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e673 expref: 15 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081675:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081682:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787548604.081696:0:5841:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004362782s 00010000:00010000:2.0:1787548604.081702:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081709:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081716:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081723:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081728:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548604.081732:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081739:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081760:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548604.081771:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548604.081815:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3418829f-2e19-44b5-ae62-1256ac42dc62+14:3316:x1874380431837056:12345-0@lo:103: Request processed in 212us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548604.081823:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787548604.081892:0:5871:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548604.081893:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431837056:0@lo:103: 00010000:00010000:3.0:1787548604.081915:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548604.081923:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec90150600/0xcb7c48919424e737 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548604.100853:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+13:7630:x1874380431836672:12345-0@lo:253: Request processed in 97730us (97818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548604.100868:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787548604.100957:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3418829f-2e19-44b5-ae62-1256ac42dc62:7630:1874380431836672:0@lo:253: 10000000:01000000:2.0:1787548604.100975:0:7630:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787548604.100978:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787548604.100980:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787548604.100982:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787548604.100983:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787548604.100984:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787548604.100985:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787548604.100987:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787548604.100988:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787548604.100990:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787548604.100991:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787548604.100993:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787548604.101008:0:7630:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787548604.111188:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787548604.112938:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787548604.113323:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787548604.113791:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787548604.114021:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787548604.114530:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787548604.115778:0:7630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787548604.310199:0:7630:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787548604.310207:0:7630:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787548604.310238:0:7630:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787548604.310294:0:7630:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787548604.310309:0:7630:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787548604.310335:0:7630:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787548604.871689:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548605.894540:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548606.919221:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548606.979410:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431837184:0@lo:13: 00000100:00100000:1.0:1787548606.979473:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548606.979533:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431837184 00000100:00100000:1.0:1787548606.979540:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431837184 00000100:00100000:1.0:1787548606.979588:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787548606.979596:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431837184:12345-0@lo:13: 00002000:00000024:1.0:1787548606.979627:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548606.979668:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431837184:12345-0@lo:13: Request processed in 72us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548606.979676:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787548606.979693:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787548606.979751:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feb81a84e00 x1874380431837184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548606.979768:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431837184:0@lo:13: 00010000:00010000:0.0:1787548607.940564:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548608.963305:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548609.031954:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431837696:0@lo:400: 00000100:00100000:2.0:1787548609.032019:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548609.032079:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787548609.032086:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431837312:0@lo:400: 00000100:00100000:2.0:1787548609.032114:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548609.032168:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431837824:0@lo:400: 00000100:00100000:2.0:1787548609.032197:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548609.032223:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431837440:0@lo:400: 00000100:00100000:2.0:1787548609.032248:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548609.032265:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787548609.032270:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431837568:0@lo:400: 00000100:00100000:2.0:1787548609.032294:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548609.032336:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431837696 00000100:00100000:2.0:1787548609.032343:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431837696 00000100:00100000:2.0:1787548609.032394:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787548609.032403:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431837696:12345-0@lo:400: 00000100:00100000:2.0:1787548609.032451:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431837696:12345-0@lo:400: Request processed in 49us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548609.032458:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787548609.032480:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431837312 00000100:00100000:2.0:1787548609.032484:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431837312 00000100:00100000:2.0:1787548609.032507:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787548609.032513:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+13:3313:x1874380431837312:12345-0@lo:400: 00000100:00100000:2.0:1787548609.032542:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+13:3313:x1874380431837312:12345-0@lo:400: Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548609.032549:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787548609.032574:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431837824 00000100:00100000:2.0:1787548609.032578:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431837824 00000100:00100000:2.0:1787548609.032595:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431837440 00000100:00100000:2.0:1787548609.032597:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431837440 00000100:00100000:2.0:1787548609.032607:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431837568 00000100:00100000:2.0:1787548609.032610:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431837568 00000100:00100000:2.0:1787548609.032623:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787548609.032638:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431837824:12345-0@lo:400: 00000100:00100000:2.0:1787548609.032671:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431837824:12345-0@lo:400: Request processed in 35us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548609.032677:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787548609.032690:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787548609.032695:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431837440:12345-0@lo:400: 00000100:00100000:2.0:1787548609.032726:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431837440:12345-0@lo:400: Request processed in 31us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548609.032732:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787548609.032743:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787548609.032749:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431837568:12345-0@lo:400: 00000100:00100000:2.0:1787548609.032775:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431837568:12345-0@lo:400: Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548609.032780:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787548609.032794:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787548609.032797:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787548609.032829:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbe300 x1874380431837568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548609.032842:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431837568:0@lo:400: 00010000:00080000:2.0:1787548609.032853:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbc000 x1874380431837440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548609.032862:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431837440:0@lo:400: 00000100:00100000:2.0:1787548609.032888:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431837312:0@lo:400: 00010000:00080000:2.0:1787548609.032896:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbc380 x1874380431837824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548609.032917:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431837824:0@lo:400: 00010000:00080000:2.0:1787548609.032928:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbed80 x1874380431837696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548609.032936:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431837696:0@lo:400: 00010000:00010000:0.0:1787548609.989798:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787548610.151516:0:7986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg613-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787548611.014448:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548612.035661:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548612.099347:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787548612.099387:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431837952:0@lo:13: 00000100:00100000:1.0:1787548612.099451:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548612.099512:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431837952 00000100:00100000:1.0:1787548612.099519:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431837952 00000100:00100000:1.0:1787548612.099573:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787548612.099582:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431837952:12345-0@lo:13: 00002000:00000024:1.0:1787548612.099616:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548612.099658:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431837952:12345-0@lo:13: Request processed in 78us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548612.099667:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787548612.099690:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787548612.099725:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feb81a84e00 x1874380431837952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548612.099743:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431837952:0@lo:13: 10000000:01000000:3.0:1787548612.099955:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787548612.099959:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fecad08a800 from 30 10000000:01000000:3.0:1787548612.099962:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787548612.100000:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.100010:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.100018:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548612.100033:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431838080:0@lo:101: 00000100:00100000:3.0:1787548612.100067:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548612.100110:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86004d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787548612.100920:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431838080 00000100:00100000:2.0:1787548612.100928:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431838080 00000100:00100000:2.0:1787548612.100972:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787548612.100981:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+13:5851:x1874380431838080:12345-0@lo:101: 00010000:00010000:2.0:1787548612.100992:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548612.101004:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e745 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e73e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548612.101026:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e73e expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548612.101036:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e73e expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548612.101046:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ed000, rc 0) 00000100:00100000:2.0:1787548612.101103:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431838080:12345-0@lo:101: Request processed in 122us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548612.101109:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787548612.101773:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431838080:0@lo:101: 00010000:00010000:3.0:1787548612.101868:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e745 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.101880:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e745 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548612.101943:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431838208:0@lo:501: 00000100:00100000:3.0:1787548612.102372:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548612.102467:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86004d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787548612.110111:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431838208 00000100:00100000:2.0:1787548612.110126:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431838208 00000100:00100000:2.0:1787548612.110291:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787548612.110302:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431838208:12345-0@lo:501: 00000100:00100000:2.0:1787548612.110698:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431838208:12345-0@lo:501: Request processed in 398us (8326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548612.110707:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787548612.110803:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431838208:0@lo:501: 00000100:00100000:3.0:1787548612.110850:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431838336:0@lo:503: 00000100:00100000:3.0:1787548612.110897:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548612.121286:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86004d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787548612.122602:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431838336 00000100:00100000:1.0:1787548612.122615:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431838336 00000100:00100000:2.0:1787548612.122668:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787548612.122691:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431838336:12345-0@lo:503: 00000100:00100000:3.0:1787548612.123399:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431838336:12345-0@lo:503: Request processed in 710us (12499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548612.123410:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787548612.126334:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431838336:0@lo:503: 00000100:00100000:1.0:1787548612.127192:0:8090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8090:1874380431838464:0@lo:502: 00000100:00100000:1.0:1787548612.127269:0:8090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548612.127324:0:8090:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec600 going to sleep for 11 seconds 00000100:00100000:0.0:1787548612.127600:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431838464 00000100:00100000:0.0:1787548612.127606:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431838464 00000100:00100000:0.0:1787548612.127661:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787548612.127671:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:8090:x1874380431838464:12345-0@lo:502: 00000100:00100000:0.0:1787548612.128230:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:8090:x1874380431838464:12345-0@lo:502: Request processed in 558us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548612.128239:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787548612.128418:0:8090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8090:1874380431838464:0@lo:502: 00000100:00100000:1.0:1787548612.128471:0:8090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8090:1874380431838592:0@lo:502: 00000100:00100000:1.0:1787548612.128599:0:8090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548612.128691:0:8090:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec600 going to sleep for 11 seconds 00000100:00100000:2.0:1787548612.130043:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431838592 00000100:00100000:2.0:1787548612.130055:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431838592 00000100:00100000:2.0:1787548612.130099:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787548612.130109:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+14:8090:x1874380431838592:12345-0@lo:502: 00000100:00100000:3.0:1787548612.132683:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+14:8090:x1874380431838592:12345-0@lo:502: Request processed in 2559us (4068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548612.132697:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787548612.133002:0:8090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8090:1874380431838592:0@lo:502: 00000040:00080000:1.0:1787548612.133038:0:8090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787548612.133255:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787548612.133277:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787548612.133288:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e745 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548612.133299:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e745 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548612.133318:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787548612.133321:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787548612.133324:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787548612.133355:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548612.133362:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548612.133371:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548612.133400:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431838720:0@lo:101: 00000100:00100000:2.0:1787548612.133439:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548612.133523:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecace219c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787548612.133623:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431838720 00000100:00100000:3.0:1787548612.133630:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431838720 00000100:00100000:3.0:1787548612.133756:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787548612.133777:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431838720:12345-0@lo:101: 00010000:00010000:3.0:1787548612.133789:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548612.133803:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec81534e00/0xcb7c48919424e753 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e74c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.133833:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec81534e00/0xcb7c48919424e753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e74c expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.133843:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec81534e00/0xcb7c48919424e753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e74c expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.133852:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec81534e00, rc 0) 00000100:00100000:3.0:1787548612.134098:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431838720:12345-0@lo:101: Request processed in 323us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548612.134105:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787548612.134252:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431838720:0@lo:101: 00010000:00010000:2.0:1787548612.134267:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e753 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548612.134275:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e753 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548612.134333:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431838848:0@lo:501: 00000100:00100000:2.0:1787548612.134360:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548612.134512:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecace219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548612.134620:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431838848 00000100:00100000:0.0:1787548612.134625:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431838848 00000100:00100000:1.0:1787548612.134664:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787548612.134682:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431838848:12345-0@lo:501: 00000100:00100000:1.0:1787548612.134936:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431838848:12345-0@lo:501: Request processed in 264us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548612.134943:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787548612.135174:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431838848:0@lo:501: 00000100:00100000:2.0:1787548612.135202:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431838976:0@lo:503: 00000100:00100000:2.0:1787548612.135244:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548612.135266:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecace219c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548612.135345:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431838976 00000100:00100000:1.0:1787548612.135350:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431838976 00000100:00100000:1.0:1787548612.135371:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787548612.135377:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431838976:12345-0@lo:503: 00000100:00100000:1.0:1787548612.135785:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431838976:12345-0@lo:503: Request processed in 406us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548612.135792:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787548612.136248:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431838976:0@lo:503: 00000100:00100000:1.0:1787548612.136656:0:8091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8091:1874380431839104:0@lo:502: 00000100:00100000:1.0:1787548612.136756:0:8091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548612.137008:0:8091:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec300 going to sleep for 11 seconds 00000100:00100000:3.0:1787548612.137044:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431839104 00000100:00100000:3.0:1787548612.137049:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431839104 00000100:00100000:3.0:1787548612.137127:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787548612.137162:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+15:8091:x1874380431839104:12345-0@lo:502: 00000100:00100000:3.0:1787548612.137391:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+15:8091:x1874380431839104:12345-0@lo:502: Request processed in 230us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548612.137398:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787548612.137479:0:8091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8091:1874380431839104:0@lo:502: 00000020:01000000:1.0:1787548612.137504:0:8091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548612.137513:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548612.137516:0:8091:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787548612.137520:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787548612.137522:0:8091:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787548612.137539:0:8091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8091:1874380431839232:0@lo:502: 00000100:00100000:1.0:1787548612.137580:0:8091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548612.137795:0:8091:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec300 going to sleep for 11 seconds 00000100:00100000:0.0:1787548612.137853:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431839232 00000100:00100000:0.0:1787548612.137858:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431839232 00000100:00100000:0.0:1787548612.137881:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787548612.137901:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+15:8091:x1874380431839232:12345-0@lo:502: 00000100:00100000:0.0:1787548612.138032:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+15:8091:x1874380431839232:12345-0@lo:502: Request processed in 131us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548612.138038:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787548612.138357:0:8091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8091:1874380431839232:0@lo:502: 00000020:01000000:1.0:1787548612.138380:0:8091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548612.138385:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548612.138386:0:8091:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787548612.138390:0:8091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787548612.138530:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787548612.138548:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787548612.138557:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e753 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548612.138570:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e753 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548612.138581:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787548612.138584:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fec8644c800 from 30 10000000:01000000:0.0:1787548612.138587:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787548612.138611:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548612.138626:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548612.138636:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548612.138651:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431839360:0@lo:101: 00000100:00100000:0.0:1787548612.138697:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548612.138841:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9044c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787548612.139043:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431839360 00000100:00100000:3.0:1787548612.139049:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431839360 00000100:00100000:1.0:1787548612.139093:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787548612.139102:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431839360:12345-0@lo:101: 00010000:00010000:1.0:1787548612.139112:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548612.139123:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e761 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e75a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548612.139180:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e75a expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548612.139191:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e75a expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548612.139200:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7e00, rc 0) 00000100:00100000:1.0:1787548612.139233:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431839360:12345-0@lo:101: Request processed in 132us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548612.139239:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787548612.139330:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431839360:0@lo:101: 00010000:00010000:0.0:1787548612.139342:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e761 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548612.139351:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e761 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548612.139396:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431839488:0@lo:501: 00000100:00100000:0.0:1787548612.139423:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548612.139451:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9044c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787548612.139499:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431839488 00000100:00100000:1.0:1787548612.139503:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431839488 00000100:00100000:1.0:1787548612.139522:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787548612.139528:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431839488:12345-0@lo:501: 00000100:00100000:1.0:1787548612.139756:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431839488:12345-0@lo:501: Request processed in 226us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548612.139781:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787548612.140065:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431839488:0@lo:501: 00000100:00100000:0.0:1787548612.140094:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431839616:0@lo:503: 00000100:00100000:0.0:1787548612.140165:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548612.140184:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9044c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787548612.140256:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431839616 00000100:00100000:1.0:1787548612.140261:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431839616 00000100:00100000:1.0:1787548612.140283:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787548612.140290:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431839616:12345-0@lo:503: 00000100:00100000:1.0:1787548612.140448:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431839616:12345-0@lo:503: Request processed in 159us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548612.140455:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787548612.140530:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431839616:0@lo:503: 00000100:00100000:0.0:1787548612.141081:0:8092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8092:1874380431839744:0@lo:502: 00000100:00100000:0.0:1787548612.141159:0:8092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548612.141197:0:8092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9044c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787548612.141425:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431839744 00000100:00100000:1.0:1787548612.141431:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431839744 00000100:00100000:1.0:1787548612.141456:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787548612.141463:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+16:8092:x1874380431839744:12345-0@lo:502: 00000100:00100000:1.0:1787548612.141628:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+16:8092:x1874380431839744:12345-0@lo:502: Request processed in 164us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548612.141635:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787548612.141723:0:8092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8092:1874380431839744:0@lo:502: 00000100:00100000:0.0:1787548612.141775:0:8092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8092:1874380431839872:0@lo:502: 00000100:00100000:0.0:1787548612.141809:0:8092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548612.141835:0:8092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9044c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787548612.142115:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431839872 00000100:00100000:2.0:1787548612.142121:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431839872 00000100:00100000:2.0:1787548612.142162:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787548612.142169:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+16:8092:x1874380431839872:12345-0@lo:502: 00000100:00100000:2.0:1787548612.142336:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+16:8092:x1874380431839872:12345-0@lo:502: Request processed in 167us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548612.142352:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787548612.142507:0:8092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8092:1874380431839872:0@lo:502: 00000040:00080000:0.0:1787548612.142529:0:8092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787548612.143006:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787548612.143023:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787548612.143032:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e761 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548612.143041:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e761 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548612.143049:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787548612.143051:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fec8644c800 from 5 10000000:01000000:1.0:1787548612.143054:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787548612.143078:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548612.143096:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548612.143105:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548612.143120:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431840000:0@lo:101: 00000100:00100000:0.0:1787548612.143336:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548612.143400:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ecb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787548612.143432:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431840000 00000100:00100000:1.0:1787548612.143437:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431840000 00000100:00100000:1.0:1787548612.143502:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787548612.143510:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431840000:12345-0@lo:101: 00010000:00010000:1.0:1787548612.143520:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548612.143532:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec813f6a00/0xcb7c48919424e76f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e768 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548612.143552:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec813f6a00/0xcb7c48919424e76f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e768 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548612.143563:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec813f6a00/0xcb7c48919424e76f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e768 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548612.143571:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6a00, rc 0) 00000100:00100000:1.0:1787548612.143613:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431840000:12345-0@lo:101: Request processed in 104us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548612.143620:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787548612.143689:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431840000:0@lo:101: 00010000:00010000:0.0:1787548612.143703:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548612.143712:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548612.143757:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431840128:0@lo:256: 00000100:00100000:0.0:1787548612.143796:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548612.144095:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9044c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787548612.144199:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431840128 00000100:00100000:3.0:1787548612.144204:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431840128 00000100:00100000:3.0:1787548612.144227:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787548612.144233:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431840128:12345-0@lo:256: 20000000:01000000:3.0:1787548612.144245:0:5848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787548612.144260:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787548612.144263:0:5848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787548612.144348:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431840128:12345-0@lo:256: Request processed in 114us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548612.144361:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787548612.144535:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431840128:0@lo:256: 10000000:01000000:0.0:1787548612.144576:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787548612.144582:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548612.144589:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548612.144601:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787548612.144603:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787548612.144605:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787548612.144621:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548612.144628:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548612.144637:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548612.144651:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431840256:0@lo:101: 00000100:00100000:0.0:1787548612.144690:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548612.144712:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9044c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787548612.144793:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431840256 00000100:00100000:3.0:1787548612.144798:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431840256 00000100:00100000:3.0:1787548612.144817:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787548612.144822:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431840256:12345-0@lo:101: 00010000:00010000:3.0:1787548612.144829:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548612.144838:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec81534000/0xcb7c48919424e77d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e776 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.144853:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec81534000/0xcb7c48919424e77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e776 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.144861:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec81534000/0xcb7c48919424e77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e776 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.144869:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec81534000, rc 0) 00000100:00100000:3.0:1787548612.145146:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431840256:12345-0@lo:101: Request processed in 302us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548612.145153:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787548612.145232:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431840256:0@lo:101: 00010000:00010000:0.0:1787548612.145243:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e77d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548612.145252:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e77d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548612.145296:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431840384:0@lo:501: 00000100:00100000:0.0:1787548612.145337:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548612.145358:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9044c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787548612.145403:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431840384 00000100:00100000:3.0:1787548612.145408:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431840384 00000100:00100000:3.0:1787548612.145426:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787548612.145431:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431840384:12345-0@lo:501: 00000100:00100000:3.0:1787548612.145638:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431840384:12345-0@lo:501: Request processed in 205us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548612.145644:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787548612.145921:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431840384:0@lo:501: 00000100:00100000:0.0:1787548612.145947:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431840512:0@lo:503: 00000100:00100000:0.0:1787548612.145990:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548612.146011:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9044c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787548612.146166:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431840512 00000100:00100000:3.0:1787548612.146170:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431840512 00000100:00100000:3.0:1787548612.146196:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787548612.146202:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431840512:12345-0@lo:503: 00000100:00100000:3.0:1787548612.146487:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431840512:12345-0@lo:503: Request processed in 284us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548612.146493:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787548612.146587:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431840512:0@lo:503: 00000100:00100000:0.0:1787548612.147053:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8093:1874380431840640:0@lo:502: 00000100:00100000:0.0:1787548612.147092:0:8093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548612.147123:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9044cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787548612.147188:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431840640 00000100:00100000:3.0:1787548612.147193:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431840640 00000100:00100000:3.0:1787548612.147214:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787548612.147221:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:8093:x1874380431840640:12345-0@lo:502: 00000100:00100000:3.0:1787548612.147452:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:8093:x1874380431840640:12345-0@lo:502: Request processed in 230us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548612.147459:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787548612.147531:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8093:1874380431840640:0@lo:502: 00000020:01000000:0.0:1787548612.147554:0:8093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787548612.147563:0:8093:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787548612.147569:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548612.147572:0:8093:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787548612.147576:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787548612.147579:0:8093:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.113@tcp to nid 0x20000c0a8ce71 (192.168.206.113@tcp) 00000020:01000000:0.0:1787548612.147603:0:8093:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787548612.147605:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787548612.147618:0:8093:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8fec882ecd28) 00000020:00000080:0.0:1787548612.147638:0:8093:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787548612.147642:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787548612.147709:0:8093:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787548612.147714:0:8093:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787548612.147721:0:8093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb7c48919424e78b 00010000:00080000:0.0:1787548612.147748:0:8093:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8feb81193000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.113@tcp at head 00010000:00010000:0.0:1787548612.148343:0:8093:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787548612.148651:0:8093:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787548612.148661:0:8093:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787548612.149630:0:8093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787548612.150001:0:8093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787548612.150054:0:8093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787548612.150127:0:8093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787548612.150742:0:8094:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787548612.150747:0:8094:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787548612.151887:0:8093:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787548612.151898:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787548612.151928:0:8093:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787548612.151949:0:8093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb7c48919424e792 00000100:00080000:3.0:1787548612.151958:0:8093:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787548612.151963:0:8093:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8feb81193000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:3.0:1787548612.151995:0:8093:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8feca71db100 x1874380431840768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787548612.152049:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431840768:0@lo:8: 00000100:00100000:0.0:1787548612.152114:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787548612.152272:0:8093:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787548612.152334:0:8093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787548612.152339:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548612.152340:0:8093:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787548612.152343:0:8093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787548612.152347:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548612.152349:0:8093:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787548612.152351:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787548612.152358:0:8093:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787548612.152380:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8093:1874380431840896:0@lo:502: 00000100:00100000:3.0:1787548612.152421:0:8093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548612.152444:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431840896 00000100:00100000:3.0:1787548612.152450:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431840896 00000100:00100000:3.0:1787548612.152482:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787548612.152490:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:8093:x1874380431840896:12345-0@lo:502: 00000100:00100000:3.0:1787548612.152692:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:8093:x1874380431840896:12345-0@lo:502: Request processed in 201us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548612.152700:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787548612.152742:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a000 going to sleep for 11 seconds 00000100:00100000:3.0:1787548612.152759:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8093:1874380431840896:0@lo:502: 00000100:00100000:2.0:1787548612.152928:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431841152:0@lo:400: 00000100:00100000:2.0:1787548612.152959:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548612.152979:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787548612.152984:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431841280:0@lo:400: 00000100:00100000:2.0:1787548612.153003:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787548612.153043:0:8093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787548612.153047:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548612.153048:0:8093:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787548612.153052:0:8093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1787548612.153111:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787548612.153126:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787548612.153134:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e77d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.153160:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e77d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548612.153170:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787548612.153172:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fec87eab370 from 1 10000000:01000000:3.0:1787548612.153175:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787548612.153195:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.153214:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.153224:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548612.153237:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431841536:0@lo:101: 00000100:00100000:3.0:1787548612.153263:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548612.153278:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec88381600 going to sleep for 11 seconds 00000100:00100000:3.0:1787548612.153292:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431841536 00000100:00100000:3.0:1787548612.153296:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431841536 00000100:00100000:3.0:1787548612.153337:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787548612.153344:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431841536:12345-0@lo:101: 00010000:00010000:3.0:1787548612.153352:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548612.153362:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec81535600/0xcb7c48919424e7a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e799 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.153381:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec81535600/0xcb7c48919424e7a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e799 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.153391:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec81535600/0xcb7c48919424e7a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e799 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.153400:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec81535600, rc 0) 00000100:00100000:3.0:1787548612.153442:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431841536:12345-0@lo:101: Request processed in 99us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548612.153449:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787548612.153580:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431841536:0@lo:101: 00010000:00010000:0.0:1787548612.153592:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e7a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548612.153601:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e7a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548612.153641:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431841664:0@lo:501: 00000100:00100000:0.0:1787548612.153665:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548612.153689:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9044c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787548612.153728:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431841664 00000100:00100000:3.0:1787548612.153738:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431841664 00000100:00100000:3.0:1787548612.153770:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787548612.153776:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431841664:12345-0@lo:501: 00000100:00100000:3.0:1787548612.153967:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431841664:12345-0@lo:501: Request processed in 189us (299us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787548612.153974:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787548612.154003:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431841664:0@lo:501: 10000000:01000000:3.0:1787548612.154022:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787548612.154028:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e7a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548612.154035:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e7a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548612.154266:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431841152 00000100:00100000:2.0:1787548612.154271:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431841152 00000100:00100000:2.0:1787548612.154358:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787548612.154366:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431841152:12345-0@lo:400: 00000100:00100000:2.0:1787548612.154413:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431841152:12345-0@lo:400: Request processed in 47us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548612.154420:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787548612.154451:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbc380 x1874380431841152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548612.154463:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431841152:0@lo:400: 00000100:00100000:2.0:1787548612.154481:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431841408:0@lo:400: 00000100:00100000:2.0:1787548612.154507:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548612.154526:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787548612.154531:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431841024:0@lo:400: 00000100:00100000:2.0:1787548612.154549:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548612.154566:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431841408 00000100:00100000:2.0:1787548612.154569:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431841408 00000100:00100000:1.0:1787548612.154646:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431840768 00000100:00100000:1.0:1787548612.154651:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431840768 00000100:00100000:1.0:1787548612.154672:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431841280 00000100:00100000:1.0:1787548612.154682:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431841280 00000100:00100000:1.0:1787548612.154704:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787548612.154712:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431841280:12345-0@lo:400: 00000100:00100000:1.0:1787548612.154752:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431841280:12345-0@lo:400: Request processed in 41us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548612.154758:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787548612.154770:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787548612.154775:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3312:x1874380431840768:12345-0@lo:8: 00010000:00080000:1.0:1787548612.154805:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:1.0:1787548612.154830:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb7c48919424e7a7 00002000:00100000:1.0:1787548612.154842:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8fecb7dba800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787548612.154847:0:6692:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787548612.154850:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787548612.154950:0:6692:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787548612.155111:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787548612.155149:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8fecb7dbf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787548612.155190:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874380431840768:12345-0@lo:8: Request processed in 414us (3076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548612.155197:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787548612.155239:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbc700 x1874380431841280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548612.155250:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431841280:0@lo:400: 00010000:00080000:1.0:1787548612.155278:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca71db100 x1874380431840768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787548622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548612.155288:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787548612.155294:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787548612.155318:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787548612.155323:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787548612.155326:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8feb81193000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787548612.155340:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787548612.155344:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431840768:0@lo:8: 00000100:00080000:3.0:1787548612.155484:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548612.155497:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431841024 00000100:00100000:3.0:1787548612.155502:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431841024 00000100:00100000:3.0:1787548612.155527:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787548612.155533:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431841024:12345-0@lo:400: 00000100:00100000:3.0:1787548612.155569:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431841024:12345-0@lo:400: Request processed in 36us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548612.155574:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787548612.155599:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbed80 x1874380431841024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548612.155608:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431841024:0@lo:400: 00000100:00100000:2.0:1787548612.155930:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787548612.155945:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431841408:12345-0@lo:400: 00000100:00100000:2.0:1787548612.155983:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431841408:12345-0@lo:400: Request processed in 40us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548612.155989:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:2.0:1787548612.156008:0:8094:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787548612.156096:0:8094:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 235032964925ns, next at 0ns, rc = 0 00010000:00080000:3.0:1787548612.156301:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbc000 x1874380431841408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548612.156336:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431841408:0@lo:400: 00000004:00080000:2.0:1787548612.196888:0:8095:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787548612.196919:0:8095:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1874380431841920:0@lo:7: 00000100:00100000:2.0:1787548612.196984:0:8095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548612.197012:0:8095:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecace21480 going to sleep for 11 seconds 00000100:00100000:2.0:1787548612.197028:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431841792:0@lo:13: 00000100:00100000:2.0:1787548612.197052:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548612.197086:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431841920 00000100:00100000:2.0:1787548612.197093:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431841920 00000100:00100000:2.0:1787548612.197172:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787548612.197182:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8095:x1874380431841920:12345-0@lo:7: 00000004:00080000:3.0:1787548612.199809:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:3.0:1787548612.199842:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787548612.201615:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431841792 00000100:00100000:3.0:1787548612.201628:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431841792 00000100:00100000:3.0:1787548612.201688:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787548612.201699:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874380431841792:12345-0@lo:13: 00002000:00000024:3.0:1787548612.201732:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787548612.201822:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874380431841792:12345-0@lo:13: Request processed in 125us (4768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548612.201829:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787548612.201877:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbf800 x1874380431841792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548612.201897:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431841792:0@lo:13: 00002000:00080000:0.0:1787548612.209261:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787548612.209269:0:6692:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787548612.209375:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8095:x1874380431841920:12345-0@lo:7: Request processed in 12190us (12387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548612.209385:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787548612.209498:0:8095:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbd500 x1874380431841920/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787548628 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548612.209514:0:8095:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1874380431841920:0@lo:7: 00000004:00080000:2.0:1787548612.209527:0:8095:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787548612.209562:0:8095:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1874380431842048:0@lo:5: 00000100:00100000:2.0:1787548612.209596:0:8095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548612.209654:0:8095:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecace21480 going to sleep for 11 seconds 00000100:00100000:0.0:1787548612.209941:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431842048 00000100:00100000:0.0:1787548612.209948:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431842048 00000100:00100000:0.0:1787548612.209991:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787548612.210000:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8095:x1874380431842048:12345-0@lo:5: 00002000:00080000:0.0:1787548612.210021:0:6690:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787548612.210024:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787548612.210264:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8095:x1874380431842048:12345-0@lo:5: Request processed in 265us (666us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787548612.210271:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787548612.210386:0:8095:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbd500 x1874380431842048/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787548628 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548612.210397:0:8095:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1874380431842048:0@lo:5: 00000004:00080000:2.0:1787548612.210412:0:8095:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787548612.210438:0:8095:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1874380431842176:0@lo:700: 00000100:00100000:2.0:1787548612.210479:0:8095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548612.210542:0:8095:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecace21480 going to sleep for 11 seconds 00000100:00100000:3.0:1787548612.211692:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431842176 00000100:00100000:3.0:1787548612.211700:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431842176 00000100:00100000:3.0:1787548612.211797:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787548612.211806:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8095:x1874380431842176:12345-0@lo:700: 00000100:00100000:3.0:1787548612.211843:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6698:1874380431842304:0@lo:700: 00000100:00100000:3.0:1787548612.211882:0:6698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548612.211907:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec88381600 going to sleep for 11 seconds 00000100:00100000:1.0:1787548612.212881:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431842304 00000100:00100000:1.0:1787548612.212888:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431842304 00000100:00100000:1.0:1787548612.212933:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548612.212941:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6698:x1874380431842304:12345-0@lo:700: 40000000:02000000:1.0:1787548612.248682:0:5862:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787548612.259374:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6698:x1874380431842304:12345-0@lo:700: Request processed in 46428us (47485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548612.259388:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787548612.259584:0:6698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca71da300 x1874380431842304/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787548628 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548612.259599:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6698:1874380431842304:0@lo:700: 40000000:02000000:3.0:1787548612.259611:0:6698:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1787548612.360151:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787548612.360173:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787548612.360391:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8095:x1874380431842176:12345-0@lo:700: Request processed in 148583us (149907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548612.360403:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787548612.360563:0:8095:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbf800 x1874380431842176/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787548628 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548612.360575:0:8095:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787548612.360592:0:8095:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1874380431842176:0@lo:700: 00000004:02000040:0.0:1787548612.403858:0:8095:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787548612.408719:0:8095:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a87b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1874380431842432:0@lo:5: 00000100:00100000:1.0:1787548612.408789:0:8095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548612.408862:0:8095:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca0a1a240 going to sleep for 11 seconds 00000100:00100000:0.0:1787548612.408919:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431842432 00000100:00100000:0.0:1787548612.408927:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431842432 00000100:00100000:0.0:1787548612.408979:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787548612.408989:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8095:x1874380431842432:12345-0@lo:5: 00002000:00080000:1.0:1787548612.414988:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787548612.415007:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787548612.417828:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8095:x1874380431842432:12345-0@lo:5: Request processed in 8834us (9033us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787548612.417839:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787548612.418005:0:8095:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feb81a87b80 x1874380431842432/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787548628 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548612.418022:0:8095:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a87b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1874380431842432:0@lo:5: 00000004:00080000:0.0:1787548612.418036:0:8095:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1787548613.059482:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548614.091420:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548615.111311:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787548615.134732:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787548616.131424:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548616.636225:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548616.636510:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416090496 00000100:00100000:0.0:1787548616.636519:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416090496 00000100:00100000:0.0:1787548616.636557:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 111 00000100:00100000:0.0:1787548616.636565:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2350:x1874380416090496:12345-192.168.206.13@tcp:250: 00010000:00080000:0.0:1787548616.636590:0:5849:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 450a7108-39f6-4004-8f60-5d2336e0cad2@192.168.206.13@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:0.0:1787548616.636618:0:5849:0:(genops.c:1385:class_connect()) connect: client 450a7108-39f6-4004-8f60-5d2336e0cad2, cookie 0xcb7c48919424e7ae 00000100:00080000:0.0:1787548616.636754:0:5849:0:(import.c:65:import_set_state_nolock()) ffff8fecaf31b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787548616.636826:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+5:2350:x1874380416090496:12345-192.168.206.13@tcp:250: Request processed in 260us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548616.636846:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 111 00000100:00100000:3.0:1787548616.646585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548616.646848:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416090368 00000100:00100000:1.0:1787548616.646857:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416090368 00000100:00100000:1.0:1787548616.646913:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 112 00000100:00100000:1.0:1787548616.646923:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+5:5581:x1874380416090368:12345-192.168.206.13@tcp:101: 00010000:00010000:1.0:1787548616.646940:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548616.646968:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec813f6000/0xcb7c48919424e7b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a20ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548616.647012:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec813f6000/0xcb7c48919424e7b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20ca expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548616.647024:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec813f6000/0xcb7c48919424e7b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20ca expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548616.647034:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6000, rc 0) 00000100:00100000:1.0:1787548616.647093:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+6:5581:x1874380416090368:12345-192.168.206.13@tcp:101: Request processed in 170us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548616.647099:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 112 00000100:00100000:1.0:1787548616.653460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548616.653544:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416090624 00000100:00100000:3.0:1787548616.653554:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416090624 00000100:00100000:3.0:1787548616.653622:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 113 00000100:00100000:3.0:1787548616.653633:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+6:5581:x1874380416090624:12345-192.168.206.13@tcp:501: 00000100:00100000:3.0:1787548616.653988:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+6:5581:x1874380416090624:12345-192.168.206.13@tcp:501: Request processed in 356us (548us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787548616.653997:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 113 00000100:00100000:3.0:1787548616.659536:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548616.659636:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416090752 00000100:00100000:1.0:1787548616.659646:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416090752 00000100:00100000:1.0:1787548616.659702:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 114 00000100:00100000:1.0:1787548616.659712:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+6:5581:x1874380416090752:12345-192.168.206.13@tcp:101: 00010000:00010000:1.0:1787548616.659728:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548616.659746:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec813f7600/0xcb7c48919424e7bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a20d1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548616.659781:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec813f7600/0xcb7c48919424e7bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20d1 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548616.659792:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec813f7600/0xcb7c48919424e7bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20d1 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548616.659801:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7600, rc 0) 00000100:00100000:1.0:1787548616.659861:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+7:5581:x1874380416090752:12345-192.168.206.13@tcp:101: Request processed in 151us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548616.659879:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 114 00000100:00100000:1.0:1787548616.664921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548616.665013:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416090880 00000100:00100000:0.0:1787548616.665021:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416090880 00000100:00100000:0.0:1787548616.665082:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 115 00000100:00100000:0.0:1787548616.665092:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+7:5581:x1874380416090880:12345-192.168.206.13@tcp:501: 00000100:00100000:0.0:1787548616.665420:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+8:5581:x1874380416090880:12345-192.168.206.13@tcp:501: Request processed in 328us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548616.665429:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 115 00000100:00100000:2.0:1787548616.668404:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548616.668561:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416091008 00000100:00100000:3.0:1787548616.668570:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416091008 00000100:00100000:3.0:1787548616.668630:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 116 00000100:00100000:3.0:1787548616.668640:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+8:5581:x1874380416091008:12345-192.168.206.13@tcp:503: 00000100:00100000:3.0:1787548616.669392:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+8:5581:x1874380416091008:12345-192.168.206.13@tcp:503: Request processed in 750us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548616.669402:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 116 00000100:00100000:3.0:1787548616.687893:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548616.689704:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416091136 00000100:00100000:1.0:1787548616.689718:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416091136 00000100:00100000:1.0:1787548616.689783:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 117 00000100:00100000:1.0:1787548616.689794:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+8:5600:x1874380416091136:12345-192.168.206.13@tcp:502: 00000100:00100000:1.0:1787548616.690176:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+8:5600:x1874380416091136:12345-192.168.206.13@tcp:502: Request processed in 382us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548616.690260:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 117 00000100:00100000:1.0:1787548616.727010:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548616.728354:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416091264 00000100:00100000:3.0:1787548616.728366:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416091264 00000100:00100000:3.0:1787548616.728440:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 118 00000100:00100000:3.0:1787548616.728451:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+8:5600:x1874380416091264:12345-192.168.206.13@tcp:502: 00000100:00100000:3.0:1787548616.728727:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+8:5600:x1874380416091264:12345-192.168.206.13@tcp:502: Request processed in 276us (1724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548616.728735:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 118 00000100:00100000:2.0:1787548616.745963:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548616.746049:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416091392 00000100:00100000:0.0:1787548616.746059:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416091392 00000100:00100000:0.0:1787548616.746102:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 119 00000100:00100000:0.0:1787548616.746111:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+8:5581:x1874380416091392:12345-192.168.206.13@tcp:101: 00010000:00010000:0.0:1787548616.746125:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548616.746163:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90151000/0xcb7c48919424e7c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a20fb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548616.746194:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90151000/0xcb7c48919424e7c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20fb expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548616.746205:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90151000/0xcb7c48919424e7c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20fb expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548616.746215:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151000, rc 0) 00000100:00100000:0.0:1787548616.746268:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+9:5581:x1874380416091392:12345-192.168.206.13@tcp:101: Request processed in 157us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548616.746275:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 119 00000100:00100000:2.0:1787548616.753599:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548616.753707:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416091520 00000100:00100000:0.0:1787548616.753726:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416091520 00000100:00100000:0.0:1787548616.753777:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 120 00000100:00100000:0.0:1787548616.753786:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+9:5581:x1874380416091520:12345-192.168.206.13@tcp:256: 20000000:01000000:0.0:1787548616.753809:0:5846:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787548616.753825:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787548616.753829:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787548616.753832:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787548616.753835:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787548616.755506:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+9:5581:x1874380416091520:12345-192.168.206.13@tcp:256: Request processed in 1712us (1917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548616.755520:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 120 00000100:00100000:2.0:1787548616.760780:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548616.760879:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416091648 00000100:00100000:3.0:1787548616.760900:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416091648 00000100:00100000:3.0:1787548616.760955:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 121 00000100:00100000:3.0:1787548616.760965:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+9:5581:x1874380416091648:12345-192.168.206.13@tcp:101: 00010000:00010000:3.0:1787548616.760980:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548616.760996:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec81534600/0xcb7c48919424e7ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2102 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548616.761022:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec81534600/0xcb7c48919424e7ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2102 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548616.761033:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec81534600/0xcb7c48919424e7ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2102 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548616.761043:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec81534600, rc 0) 00000100:00100000:3.0:1787548616.761100:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5581:x1874380416091648:12345-192.168.206.13@tcp:101: Request processed in 136us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548616.761107:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 121 00000100:00100000:2.0:1787548616.764839:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548616.764963:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416091776 00000100:00100000:0.0:1787548616.764974:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416091776 00000100:00100000:0.0:1787548616.765029:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 122 00000100:00100000:0.0:1787548616.765040:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5581:x1874380416091776:12345-192.168.206.13@tcp:501: 00000100:00100000:0.0:1787548616.765349:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5581:x1874380416091776:12345-192.168.206.13@tcp:501: Request processed in 310us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548616.765357:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 122 00000100:00100000:1.0:1787548616.769619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548616.769840:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416091904 00000100:00100000:0.0:1787548616.769849:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416091904 00000100:00100000:0.0:1787548616.769903:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 123 00000100:00100000:0.0:1787548616.769912:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5581:x1874380416091904:12345-192.168.206.13@tcp:503: 00000100:00100000:0.0:1787548616.770471:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5581:x1874380416091904:12345-192.168.206.13@tcp:503: Request processed in 558us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548616.770480:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 123 00000100:00100000:2.0:1787548616.775278:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548616.775377:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416092032 00000100:00100000:3.0:1787548616.775387:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416092032 00000100:00100000:3.0:1787548616.775447:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 124 00000100:00100000:3.0:1787548616.775457:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5605:x1874380416092032:12345-192.168.206.13@tcp:502: 00000100:00100000:3.0:1787548616.775725:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5605:x1874380416092032:12345-192.168.206.13@tcp:502: Request processed in 269us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548616.775734:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 124 00000100:00100000:2.0:1787548616.779652:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548616.779741:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416092160 00000100:00100000:0.0:1787548616.779750:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416092160 00000100:00100000:0.0:1787548616.779818:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 125 00000100:00100000:0.0:1787548616.779829:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5605:x1874380416092160:12345-192.168.206.13@tcp:502: 00000100:00100000:0.0:1787548616.780050:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5605:x1874380416092160:12345-192.168.206.13@tcp:502: Request processed in 222us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548616.780059:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 125 00000100:00100000:0.0:1787548616.789440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548616.789574:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416092288 00000100:00100000:3.0:1787548616.789601:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416092288 00000100:00100000:3.0:1787548616.789672:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 4 00000100:00100000:3.0:1787548616.789682:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1874380416092288:12345-192.168.206.13@tcp:38: 00010000:00080000:3.0:1787548616.789738:0:5856:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:3.0:1787548616.789799:0:5856:0:(genops.c:1385:class_connect()) connect: client e4505aba-b49a-4ae4-be2d-9f5ba513779c, cookie 0xcb7c48919424e7d1 00000004:00100000:3.0:1787548616.789837:0:5856:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787548616.789844:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787548616.860779:0:5856:0:(import.c:65:import_set_state_nolock()) ffff8fec905d5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787548616.860898:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2350:x1874380416092288:12345-192.168.206.13@tcp:38: Request processed in 71213us (71462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548616.860911:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 4 00010000:00010000:0.0:1787548617.156754:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548617.219446:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431842560:0@lo:13: 00000100:00100000:2.0:1787548617.219550:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548617.219578:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874380431842944:0@lo:400: 00000100:00100000:3.0:1787548617.219648:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548617.219665:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431843072:0@lo:400: 00000100:00100000:3.0:1787548617.219689:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787548617.219700:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431842816:0@lo:400: 00000100:00100000:2.0:1787548617.219724:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548617.219754:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787548617.219760:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548617.219765:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431842688:0@lo:400: 00000100:00100000:3.0:1787548617.219799:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431843328:0@lo:400: 00000100:00100000:2.0:1787548617.219815:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548617.219850:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548617.219859:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431843200:0@lo:400: 00000100:00100000:3.0:1787548617.219899:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431842560 00000100:00100000:2.0:1787548617.219904:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548617.219909:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431842560 00000100:00100000:2.0:1787548617.219977:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431842944 00000100:00100000:3.0:1787548617.219986:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787548617.219986:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431842944 00000100:00100000:3.0:1787548617.220002:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431842560:12345-0@lo:13: 00000100:00100000:2.0:1787548617.220036:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431842816 00002000:00000024:3.0:1787548617.220041:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548617.220054:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431842816 00000100:00100000:2.0:1787548617.220076:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431843200 00000100:00100000:2.0:1787548617.220079:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431843200 00000100:00100000:2.0:1787548617.220107:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787548617.220118:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874380431842944:12345-0@lo:400: 00000100:00100000:3.0:1787548617.220127:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431842560:12345-0@lo:13: Request processed in 126us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548617.220171:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787548617.220207:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431843072 00000100:00100000:3.0:1787548617.220212:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431843072 00000100:00100000:2.0:1787548617.220225:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874380431842944:12345-0@lo:400: Request processed in 108us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548617.220235:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787548617.220256:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787548617.220263:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431842816:12345-0@lo:400: 00000100:00100000:2.0:1787548617.220311:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431842816:12345-0@lo:400: Request processed in 48us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548617.220316:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787548617.220337:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787548617.220349:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431843200:12345-0@lo:400: 00000100:00100000:3.0:1787548617.220351:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431843328 00000100:00100000:3.0:1787548617.220357:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431843328 00000100:00100000:2.0:1787548617.220393:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431843200:12345-0@lo:400: Request processed in 47us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548617.220394:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787548617.220409:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431843072:12345-0@lo:400: 00000100:00100000:2.0:1787548617.220427:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787548617.220469:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431843072:12345-0@lo:400: Request processed in 61us (745us total) trans 0 rc 0/0 00000100:00080000:2.0:1787548617.220483:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787548617.220491:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787548617.220494:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787548617.220499:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787548617.220530:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787548617.220541:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431843328:12345-0@lo:400: 00010000:00080000:2.0:1787548617.220554:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca71dad80 x1874380431843200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548617.220573:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431843200:0@lo:400: 00000100:00100000:3.0:1787548617.220585:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431843328:12345-0@lo:400: Request processed in 42us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548617.220597:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787548617.220598:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca71dbb80 x1874380431843072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548617.220618:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431843072:0@lo:400: 00010000:00080000:3.0:1787548617.220643:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca71d9880 x1874380431842816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787548617.220654:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feb81a86a00 x1874380431842560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548617.220663:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431842816:0@lo:400: 00000100:00100000:2.0:1787548617.220683:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431842560:0@lo:13: 00010000:00080000:3.0:1787548617.220691:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca71d8700 x1874380431843328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548617.220702:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787548617.220724:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431843328:0@lo:400: 00010000:00080000:3.0:1787548617.220747:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca71d8380 x1874380431842944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548617.220758:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874380431842944:0@lo:400: 00000100:00100000:1.0:1787548617.220906:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431842688 00000100:00100000:1.0:1787548617.220911:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431842688 00000100:00100000:1.0:1787548617.220949:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787548617.220956:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec900bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431842688:12345-0@lo:400: 00000100:00100000:1.0:1787548617.221003:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec900bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431842688:12345-0@lo:400: Request processed in 48us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548617.221010:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787548617.221391:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787548617.221404:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431843456:0@lo:13: 00000100:00100000:1.0:1787548617.221436:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548617.221509:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431843456 00000100:00100000:0.0:1787548617.221513:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431843456 00000100:00100000:0.0:1787548617.221545:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787548617.221552:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431843456:12345-0@lo:13: 00002000:00000024:0.0:1787548617.221575:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548617.221610:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431843456:12345-0@lo:13: Request processed in 58us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548617.221616:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787548617.221682:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecad283480 x1874380431843456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548617.221696:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431843456:0@lo:13: 00000100:00100000:2.0:1787548617.221865:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431842688:0@lo:400: 00000100:00100000:2.0:1787548617.864669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548617.864827:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416092416 00000100:00100000:3.0:1787548617.864837:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416092416 00000100:00100000:3.0:1787548617.864914:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 5 00000100:00100000:3.0:1787548617.864925:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:0:x1874380416092416:12345-192.168.206.13@tcp:41: 00000004:00000024:3.0:1787548617.864965:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787548617.865037:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:0:x1874380416092416:12345-192.168.206.13@tcp:41: Request processed in 114us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548617.865045:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 5 00000100:00080000:2.0:1787548617.865122:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548617.870426:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548617.870612:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416092544 00000100:00100000:0.0:1787548617.870621:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416092544 00000100:00100000:0.0:1787548617.870708:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 6 00000100:00100000:0.0:1787548617.870718:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:5581:x1874380416092544:12345-192.168.206.13@tcp:41: 00000004:00000024:0.0:1787548617.870746:0:5856:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787548617.870819:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:5581:x1874380416092544:12345-192.168.206.13@tcp:41: Request processed in 102us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548617.870827:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 6 00000100:00100000:1.0:1787548617.873891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548617.874049:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416092672 00000100:00100000:0.0:1787548617.874059:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416092672 00000100:00100000:0.0:1787548617.874113:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:0.0:1787548617.874123:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:5581:x1874380416092672:12345-192.168.206.13@tcp:40: 00000100:00100000:0.0:1787548617.874270:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:5581:x1874380416092672:12345-192.168.206.13@tcp:40: Request processed in 147us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548617.874287:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:2.0:1787548617.881063:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548617.881110:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548617.881168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548617.881231:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548617.881265:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416092800 00000100:00100000:2.0:1787548617.881274:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416092800 00000100:00100000:2.0:1787548617.881319:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416092928 00000100:00100000:2.0:1787548617.881323:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416092928 00000100:00100000:2.0:1787548617.881337:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 8 00000100:00100000:2.0:1787548617.881344:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1874380416092800:12345-192.168.206.13@tcp:8: 00010000:00080000:2.0:1787548617.881374:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:2.0:1787548617.881403:0:6691:0:(genops.c:1385:class_connect()) connect: client e4505aba-b49a-4ae4-be2d-9f5ba513779c, cookie 0xcb7c48919424e7d8 00002000:00100000:2.0:1787548617.881416:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e4505aba-b49a-4ae4-be2d-9f5ba513779c/ffff8fecbcb44000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787548617.881426:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787548617.882039:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787548617.882069:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8fecbcb47000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787548617.882206:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416093184 00000100:00100000:3.0:1787548617.882211:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416093184 00000100:00100000:3.0:1787548617.882246:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 127 00000100:00100000:3.0:1787548617.882253:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec900bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2352:x1874380416093184:12345-192.168.206.13@tcp:400: 00000100:00100000:0.0:1787548617.882330:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416093056 00000100:00100000:0.0:1787548617.882334:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416093056 00000100:00100000:0.0:1787548617.882360:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 0 00000100:00100000:0.0:1787548617.882367:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:5581:x1874380416093056:12345-192.168.206.13@tcp:33: 00000100:00100000:2.0:1787548617.883388:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2350:x1874380416092800:12345-192.168.206.13@tcp:8: Request processed in 2038us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548617.883397:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 8 00000100:00100000:2.0:1787548617.883427:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00100000:2.0:1787548617.883433:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1874380416092928:12345-192.168.206.13@tcp:8: 00010000:00080000:2.0:1787548617.883453:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:2.0:1787548617.883476:0:6691:0:(genops.c:1385:class_connect()) connect: client e4505aba-b49a-4ae4-be2d-9f5ba513779c, cookie 0xcb7c48919424e7df 00002000:00100000:2.0:1787548617.883485:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e4505aba-b49a-4ae4-be2d-9f5ba513779c/ffff8fecbcb42800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787548617.883494:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787548617.883809:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787548617.883832:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8fecbcb43800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787548617.892378:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec900bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2352:x1874380416093184:12345-192.168.206.13@tcp:400: Request processed in 10112us (11255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548617.892393:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 127 00000100:00100000:2.0:1787548617.895321:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2350:x1874380416092928:12345-192.168.206.13@tcp:8: Request processed in 11874us (14077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548617.895335:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 9 00000004:00080000:2.0:1787548617.904308:0:5857:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 21894us 00000004:00200000:2.0:1787548617.912925:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787548617.913110:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:5581:x1874380416093056:12345-192.168.206.13@tcp:33: Request processed in 30737us (32051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548617.913124:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 0 00000100:00100000:2.0:1787548618.109192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548618.109344:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416093312 00000100:00100000:3.0:1787548618.109354:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416093312 00000100:00100000:3.0:1787548618.109433:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 8 00000100:00100000:3.0:1787548618.109443:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:5622:x1874380416093312:12345-192.168.206.13@tcp:101: 00010000:00010000:3.0:1787548618.109460:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548618.109521:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec81534400/0xcb7c48919424e7e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a212c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548618.109580:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec81535c00/0xcb7c48919424e7ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548618.109593:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec81535c00/0xcb7c48919424e7ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548618.109608:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec81535c00/0xcb7c48919424e7ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548618.109790:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787548618.109794:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548618.109874:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec81535c00/0xcb7c48919424e7ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548618.109910:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec81534400/0xcb7c48919424e7e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a212c expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548618.109925:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec81535c00/0xcb7c48919424e7ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a212c expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548618.109934:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93100) 00010000:00010000:3.0:1787548618.109936:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787548618.109940:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec81535c00, rc 0) 00000100:00100000:3.0:1787548618.110004:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:5622:x1874380416093312:12345-192.168.206.13@tcp:101: Request processed in 562us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548618.110012:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 8 00010000:00010000:0.0:1787548618.181448:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787548618.277616:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e4505aba-b49a-4ae4-be2d-9f5ba513779c 00010000:00010000:0.0:1787548619.203442:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548620.191338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548620.191449:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416093440 00000100:00100000:0.0:1787548620.191459:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416093440 00000100:00100000:0.0:1787548620.191529:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00100000:0.0:1787548620.191540:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:5675:x1874380416093440:12345-192.168.206.13@tcp:41: 00000004:00000024:0.0:1787548620.191581:0:5856:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787548620.191648:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:5675:x1874380416093440:12345-192.168.206.13@tcp:41: Request processed in 110us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548620.191655:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00080000:2.0:1787548620.193570:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787548620.204658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548620.204736:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416093568 00000100:00100000:0.0:1787548620.204745:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416093568 00000100:00100000:0.0:1787548620.204812:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00100000:0.0:1787548620.204822:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:5675:x1874380416093568:12345-192.168.206.13@tcp:13: 00002000:00000024:0.0:1787548620.204857:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548620.204919:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:5675:x1874380416093568:12345-192.168.206.13@tcp:13: Request processed in 98us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548620.204938:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00080000:2.0:1787548620.205328:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548620.211432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548620.211521:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416093696 00000100:00100000:0.0:1787548620.211532:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416093696 00000100:00100000:0.0:1787548620.211598:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:0.0:1787548620.211608:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:5675:x1874380416093696:12345-192.168.206.13@tcp:13: 00002000:00000024:0.0:1787548620.211643:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548620.211710:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:5675:x1874380416093696:12345-192.168.206.13@tcp:13: Request processed in 104us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548620.211717:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00080000:2.0:1787548620.211783:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787548620.229572:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548621.252288:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787548621.389899:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000001:00100000:3.0:1787548621.890050:0:5878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e4505aba-b49a-4ae4-be2d-9f5ba513779c 00010000:00010000:0.0:1787548622.275361:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548622.339465:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431843584:0@lo:400: 00000100:00100000:1.0:1787548622.339534:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548622.339535:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431843712:0@lo:400: 00000100:00100000:3.0:1787548622.339565:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548622.339574:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431844096:0@lo:400: 00000100:00100000:1.0:1787548622.339598:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548622.339627:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431843840:0@lo:400: 00000100:00100000:1.0:1787548622.339650:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548622.339669:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431844352:0@lo:13: 00000100:00100000:3.0:1787548622.339670:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431844224:0@lo:400: 00000100:00100000:3.0:1787548622.339693:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548622.339693:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548622.339710:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787548622.339715:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431843968:0@lo:400: 00000100:00100000:1.0:1787548622.339735:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548622.339765:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431843584 00000100:00100000:1.0:1787548622.339772:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431843584 00000100:00100000:3.0:1787548622.339796:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431843712 00000100:00100000:3.0:1787548622.339799:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431843712 00000100:00100000:1.0:1787548622.339812:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787548622.339818:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431844096 00000100:00100000:1.0:1787548622.339819:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431843584:12345-0@lo:400: 00000100:00100000:3.0:1787548622.339820:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431844096 00000100:00100000:3.0:1787548622.339840:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431843840 00000100:00100000:3.0:1787548622.339842:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431843840 00000100:00100000:3.0:1787548622.339856:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787548622.339862:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431843712:12345-0@lo:400: 00000100:00100000:1.0:1787548622.339862:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431843584:12345-0@lo:400: Request processed in 43us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548622.339869:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787548622.339897:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431844224 00000100:00100000:1.0:1787548622.339901:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431844224 00000100:00100000:3.0:1787548622.339902:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431843712:12345-0@lo:400: Request processed in 40us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548622.339908:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787548622.339922:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787548622.339925:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431843968 00000100:00100000:1.0:1787548622.339927:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431843968 00000100:00100000:3.0:1787548622.339928:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431844096:12345-0@lo:400: 00000100:00100000:1.0:1787548622.339942:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787548622.339948:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431844224:12345-0@lo:400: 00000100:00100000:3.0:1787548622.339952:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431844096:12345-0@lo:400: Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548622.339958:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787548622.339968:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787548622.339973:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431844224:12345-0@lo:400: Request processed in 25us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548622.339974:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431843840:12345-0@lo:400: 00000100:00100000:1.0:1787548622.339984:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787548622.339996:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787548622.339999:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431843840:12345-0@lo:400: Request processed in 26us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548622.340001:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431843968:12345-0@lo:400: 00000100:00100000:3.0:1787548622.340005:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787548622.340018:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787548622.340022:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787548622.340024:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787548622.340027:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431843968:12345-0@lo:400: Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548622.340032:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787548622.340049:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431843712:0@lo:400: 00010000:00080000:1.0:1787548622.340054:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feb81a85500 x1874380431843968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787548622.340059:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feb81a87b80 x1874380431844224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548622.340065:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431843968:0@lo:400: 00000100:00100000:3.0:1787548622.340067:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431844224:0@lo:400: 00000100:00100000:1.0:1787548622.340074:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431843840:0@lo:400: 00000100:00100000:1.0:1787548622.340091:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431843584:0@lo:400: 00000100:00100000:1.0:1787548622.340102:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431844096:0@lo:400: 00000100:00100000:0.0:1787548622.340371:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431844352 00000100:00100000:0.0:1787548622.340375:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431844352 00000100:00100000:0.0:1787548622.340413:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787548622.340421:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431844352:12345-0@lo:13: 00002000:00000024:0.0:1787548622.340447:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548622.340485:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431844352:12345-0@lo:13: Request processed in 65us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548622.340491:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787548622.340529:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec90bd3800 x1874380431844352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548622.340543:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431844352:0@lo:13: 00000100:00100000:3.0:1787548622.340553:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787548622.340559:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431844480:0@lo:13: 00000100:00100000:3.0:1787548622.342528:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548622.342795:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431844480 00000100:00100000:0.0:1787548622.342802:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431844480 00000100:00100000:0.0:1787548622.342847:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787548622.342856:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431844480:12345-0@lo:13: 00002000:00000024:0.0:1787548622.342884:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548622.342935:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431844480:12345-0@lo:13: Request processed in 80us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548622.342947:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787548622.343032:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecad280a80 x1874380431844480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548622.343049:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431844480:0@lo:13: 00000001:02000400:1.0:1787548622.683411:0:8298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787548622.923292:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548622.923337:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548622.923376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548622.923393:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416093952 00000100:00100000:0.0:1787548622.923402:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416093952 00000100:00100000:3.0:1787548622.923417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548622.923456:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416094208 00000100:00100000:3.0:1787548622.923461:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416094208 00000100:00100000:0.0:1787548622.923466:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 24 00000100:00100000:0.0:1787548622.923479:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416093952:12345-192.168.206.13@tcp:400: 00000100:00100000:3.0:1787548622.923498:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416094080 00000100:00100000:3.0:1787548622.923502:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416094080 00000100:00100000:3.0:1787548622.923522:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:3.0:1787548622.923529:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416094208:12345-192.168.206.13@tcp:400: 00000100:00100000:0.0:1787548622.923547:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416093952:12345-192.168.206.13@tcp:400: Request processed in 71us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548622.923556:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 24 00000100:00100000:3.0:1787548622.923565:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416094208:12345-192.168.206.13@tcp:400: Request processed in 35us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548622.923573:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00080000:0.0:1787548622.923576:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787548622.923581:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787548622.923584:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548622.923593:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:3.0:1787548622.923601:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416094080:12345-192.168.206.13@tcp:400: 00000100:00100000:3.0:1787548622.923639:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416094080:12345-192.168.206.13@tcp:400: Request processed in 28us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548622.923646:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:2.0:1787548622.924462:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416093824 00000100:00100000:2.0:1787548622.924469:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416093824 00000100:00100000:2.0:1787548622.924550:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 129 00000100:00100000:2.0:1787548622.924559:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2351:x1874380416093824:12345-192.168.206.13@tcp:400: 00000100:00100000:2.0:1787548622.924605:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2351:x1874380416093824:12345-192.168.206.13@tcp:400: Request processed in 47us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548622.924622:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 129 00010000:00010000:0.0:1787548623.300956:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548624.324345:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548625.347418:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787548626.153432:0:8446:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff28725b70 20000000:00000080:2.0:1787548626.153450:0:8446:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fecb513ec00 uarg=0000000000000000 20000000:01000000:2.0:1787548626.153484:0:8446:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787548626.153486:0:8446:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787548626.153488:0:8446:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787548626.153492:0:8446:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787548626.153497:0:8446:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787548626.153509:0:8446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787548626.153511:0:8446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787548626.153891:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787548626.153894:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787548626.155752:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787548626.156758:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787548626.156838:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787548626.156879:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1787548626.156894:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787548626.156896:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787548626.158357:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787548626.159450:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787548626.159514:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787548626.159811:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787548626.159831:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787548626.159833:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787548626.160983:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787548626.161962:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787548626.162032:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1787548626.162486:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1787548626.162504:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787548626.162507:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787548626.164317:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787548626.164972:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787548626.165020:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787548626.165427:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1787548626.165449:0:8446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787548626.165469:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.165501:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e6f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e6ea expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.165508:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec81534800/0xcb7c48919424e71b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e714 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.165514:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e73e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.165520:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec81534e00/0xcb7c48919424e753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e74c expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.165538:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e75a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.165545:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec81534000/0xcb7c48919424e77d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e776 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.165552:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec81535600/0xcb7c48919424e7a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e799 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.165560:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec813f6000/0xcb7c48919424e7b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20ca expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.165567:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec813f7600/0xcb7c48919424e7bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20d1 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.165574:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.165622:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec813f7600/0xcb7c48919424e7bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20d1 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.165647:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fec813f7600/0xcb7c48919424e7bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20d1 expref: 9 pid: 5846 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.165661:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431844608:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548626.165957:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec813f6000/0xcb7c48919424e7b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20ca expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.165966:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fec813f6000/0xcb7c48919424e7b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20ca expref: 9 pid: 5846 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.165974:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431844736:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548626.166005:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec81535600/0xcb7c48919424e7a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e799 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.166012:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fec81535600/0xcb7c48919424e7a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e799 expref: 18 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.166020:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431844864:0@lo:104: 00000100:00100000:3.0:1787548626.166068:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787548626.166108:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec81534000/0xcb7c48919424e77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e776 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.166116:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fec81534000/0xcb7c48919424e77d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e776 expref: 18 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.166158:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431844992:0@lo:104: 00000100:00100000:3.0:1787548626.166182:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787548626.166202:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e75a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.166210:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e75a expref: 18 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.166218:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431845120:0@lo:104: 00010000:00010000:3.0:1787548626.166253:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec81534e00/0xcb7c48919424e753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e74c expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.166260:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fec81534e00/0xcb7c48919424e753 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e74c expref: 18 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.166267:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431845248:0@lo:104: 00010000:00010000:3.0:1787548626.166292:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e73e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.166299:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e745 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e73e expref: 18 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.166307:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431845376:0@lo:104: 00010000:00010000:3.0:1787548626.166344:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec81534800/0xcb7c48919424e71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e714 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.166352:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fec81534800/0xcb7c48919424e71b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e714 expref: 18 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.166372:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90096300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431845504:0@lo:104: 00010000:00010000:3.0:1787548626.166398:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e6ea expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.166406:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e6f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e6ea expref: 18 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.166414:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431845632:0@lo:104: 00000100:00100000:3.0:1787548626.166430:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548626.167072:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787548626.167098:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548626.167113:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548626.167122:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548626.167147:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548626.167157:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548626.167165:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431844864 00000100:00100000:1.0:1787548626.167172:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431844864 00000100:00100000:1.0:1787548626.167208:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431844992 00000100:00100000:1.0:1787548626.167217:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431844992 00000100:00100000:1.0:1787548626.167235:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431845120 00000100:00100000:1.0:1787548626.167248:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431845120 00000100:00100000:1.0:1787548626.167260:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431845248 00000100:00100000:1.0:1787548626.167263:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431845248 00000100:00100000:1.0:1787548626.167271:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431845376 00000100:00100000:1.0:1787548626.167273:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431845376 00000100:00100000:1.0:1787548626.167282:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431845504 00000100:00100000:1.0:1787548626.167284:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431845504 00000100:00100000:1.0:1787548626.167293:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431845632 00000100:00100000:1.0:1787548626.167296:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431845632 00000100:00100000:1.0:1787548626.167309:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787548626.167318:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+9:8446:x1874380431844864:12345-0@lo:104: 00010000:00010000:1.0:1787548626.167331:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e7a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.167393:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787548626.167400:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+9:8446:x1874380431844864:12345-0@lo:104: Request processed in 84us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548626.167407:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787548626.167426:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787548626.167432:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+8:8446:x1874380431844992:12345-0@lo:104: 00010000:00010000:1.0:1787548626.167440:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e77d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.167485:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787548626.167492:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+8:8446:x1874380431844992:12345-0@lo:104: Request processed in 60us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548626.167498:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787548626.167758:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431844864:0@lo:104: 00000100:00100000:3.0:1787548626.167768:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431844992:0@lo:104: 00000100:00100000:1.0:1787548626.168000:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787548626.168015:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+7:8446:x1874380431845120:12345-0@lo:104: 00010000:00010000:1.0:1787548626.168024:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e761 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.168084:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787548626.168090:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+7:8446:x1874380431845120:12345-0@lo:104: Request processed in 78us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548626.168097:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787548626.168112:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787548626.168119:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+6:8446:x1874380431845248:12345-0@lo:104: 00010000:00010000:1.0:1787548626.168127:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e753 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.168177:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787548626.168182:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+6:8446:x1874380431845248:12345-0@lo:104: Request processed in 65us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548626.168188:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787548626.168202:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787548626.168208:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+5:8446:x1874380431845376:12345-0@lo:104: 00010000:00010000:1.0:1787548626.168216:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e745 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.168255:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787548626.168260:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+5:8446:x1874380431845376:12345-0@lo:104: Request processed in 54us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548626.168266:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787548626.168280:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787548626.168294:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+4:8446:x1874380431845504:12345-0@lo:104: 00010000:00010000:1.0:1787548626.168303:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e71b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.168333:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787548626.168339:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+4:8446:x1874380431845504:12345-0@lo:104: Request processed in 46us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548626.168344:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787548626.168359:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787548626.168365:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+3:8446:x1874380431845632:12345-0@lo:104: 00010000:00010000:1.0:1787548626.168372:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e6f1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.168397:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787548626.168402:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+3:8446:x1874380431845632:12345-0@lo:104: Request processed in 38us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548626.168407:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787548626.168428:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787548626.168434:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e7a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.168442:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec81535400 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:1.0:1787548626.168446:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e7a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.168454:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e7a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548626.168462:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e7a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548626.168475:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787548626.168513:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e7a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.168520:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787548626.168887:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431845120:0@lo:104: 00000100:00100000:3.0:1787548626.168897:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431845248:0@lo:104: 00000100:00100000:3.0:1787548626.168904:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431845376:0@lo:104: 00000100:00100000:3.0:1787548626.168911:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90096300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431845504:0@lo:104: 00000100:00100000:3.0:1787548626.168917:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431845632:0@lo:104: 00010000:00010000:1.0:1787548626.169153:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e7a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169163:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e799 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e7a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169178:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787548626.169182:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e77d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169189:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150000 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:1.0:1787548626.169192:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e77d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169200:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e77d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548626.169206:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e77d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548626.169212:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787548626.169229:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e77d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169235:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548626.169259:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e77d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169266:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e776 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e77d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169275:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787548626.169278:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e761 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169284:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151600 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:1.0:1787548626.169287:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e761 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169293:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e761 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548626.169300:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e761 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548626.169305:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787548626.169321:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e761 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169327:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548626.169342:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e761 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169348:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e75a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e761 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169356:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787548626.169365:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e753 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169371:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec800 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:1.0:1787548626.169374:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e753 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169380:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e753 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548626.169386:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e753 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548626.169391:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787548626.169406:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e753 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169412:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548626.169417:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e753 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169423:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec800/0xcb7c48919424e74c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e753 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169434:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787548626.169437:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e745 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169443:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec81534c00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:1.0:1787548626.169446:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e745 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169463:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e745 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548626.169470:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e745 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548626.169474:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787548626.169503:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e745 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.169510:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548626.169515:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e745 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548626.169631:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787548626.169783:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548626.169797:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e71b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548626.169804:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6200 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:2.0:1787548626.169807:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e71b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548626.169814:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e71b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787548626.169820:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e71b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548626.169825:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787548626.169842:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e71b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548626.169848:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787548626.169852:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e71b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548626.169859:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424e714 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e71b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548626.169869:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548626.169871:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548626.169873:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548626.170172:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431845760:0@lo:103: 00000100:00100000:3.0:1787548626.170222:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548626.170269:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431846272:0@lo:103: 00000100:00100000:3.0:1787548626.170290:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548626.170313:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787548626.170319:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431845888:0@lo:103: 00000100:00100000:3.0:1787548626.170339:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548626.170356:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431846400:0@lo:103: 00000100:00100000:3.0:1787548626.170385:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548626.170425:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431845760 00000100:00100000:3.0:1787548626.170430:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431845760 00010000:00010000:3.0:1787548626.170453:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec81535600/0xcb7c48919424e7a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e799 expref: 19 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.170486:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431846272 00000100:00100000:3.0:1787548626.170489:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431846272 00010000:00010000:3.0:1787548626.170500:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e745 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e73e expref: 20 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.170510:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431845888 00000100:00100000:3.0:1787548626.170513:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431845888 00010000:00010000:1.0:1787548626.170613:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec81534c00/0xcb7c48919424e73e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e745 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548626.171013:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548626.171016:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548626.171018:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548626.171116:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431846016:0@lo:103: 00000100:00100000:1.0:1787548626.171165:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548626.171180:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787548626.171185:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431846144:0@lo:103: 00000100:00100000:1.0:1787548626.171202:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787548626.171274:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec81534000/0xcb7c48919424e77d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e776 expref: 21 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.171292:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431846400 00000100:00100000:3.0:1787548626.171295:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431846400 00010000:00010000:3.0:1787548626.171311:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec81534800/0xcb7c48919424e71b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e714 expref: 22 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.171320:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431846016 00000100:00100000:3.0:1787548626.171322:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431846016 00010000:00010000:3.0:1787548626.171335:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e75a expref: 23 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.171344:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431846144 00000100:00100000:3.0:1787548626.171347:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431846144 00010000:00010000:3.0:1787548626.171355:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec81534e00/0xcb7c48919424e753 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e74c expref: 24 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.171367:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787548626.171383:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+24:3313:x1874380431845760:12345-0@lo:103: 00010000:00010000:3.0:1787548626.171395:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548626.171401:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec81535600/0xcb7c48919424e7a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e799 expref: 24 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.171411:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec81535600/0xcb7c48919424e7a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e799 expref: 24 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.171426:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec81535600/0xcb7c48919424e7a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e799 expref: 24 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.171440:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548626.171482:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+23:3313:x1874380431845760:12345-0@lo:103: Request processed in 99us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548626.171489:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787548626.171507:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787548626.171514:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+22:3313:x1874380431846272:12345-0@lo:103: 00000100:00100000:2.0:1787548626.171792:0:5841:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787548626.171801:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787548626.171945:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431845760:0@lo:103: 00010000:00010000:3.0:1787548626.172126:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548626.172149:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e745 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e73e expref: 22 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172159:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e73e expref: 22 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172171:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e745 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e73e expref: 22 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172181:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548626.172222:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+21:3313:x1874380431846272:12345-0@lo:103: Request processed in 708us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548626.172251:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787548626.172268:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787548626.172276:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+20:3313:x1874380431845888:12345-0@lo:103: 00010000:00010000:3.0:1787548626.172285:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548626.172289:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec81534000/0xcb7c48919424e77d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e776 expref: 20 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172299:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec81534000/0xcb7c48919424e77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e776 expref: 20 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172309:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec81534000/0xcb7c48919424e77d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e776 expref: 20 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172317:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548626.172341:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431845888:12345-0@lo:103: Request processed in 67us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548626.172348:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787548626.172359:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787548626.172365:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:3313:x1874380431846400:12345-0@lo:103: 00010000:00010000:3.0:1787548626.172372:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548626.172376:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec81534800/0xcb7c48919424e71b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e714 expref: 18 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172385:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec81534800/0xcb7c48919424e71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e714 expref: 18 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172395:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec81534800/0xcb7c48919424e71b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e714 expref: 18 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172413:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548626.172436:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:3313:x1874380431846400:12345-0@lo:103: Request processed in 71us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548626.172443:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787548626.172455:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787548626.172461:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+16:3315:x1874380431846016:12345-0@lo:103: 00010000:00010000:3.0:1787548626.172468:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548626.172472:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e75a expref: 16 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172480:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e75a expref: 16 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172490:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec813f7e00/0xcb7c48919424e761 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e75a expref: 16 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172500:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548626.172541:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+15:3315:x1874380431846016:12345-0@lo:103: Request processed in 80us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548626.172548:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787548626.172562:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787548626.172569:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd063b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:3315:x1874380431846144:12345-0@lo:103: 00010000:00010000:3.0:1787548626.172577:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548626.172582:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec81534e00/0xcb7c48919424e753 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e74c expref: 14 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172590:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec81534e00/0xcb7c48919424e753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e74c expref: 14 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172609:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec81534e00/0xcb7c48919424e753 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e74c expref: 14 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.172617:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548626.172654:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd063b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+13:3315:x1874380431846144:12345-0@lo:103: Request processed in 85us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548626.172661:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1787548626.172735:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548626.172760:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431845888:0@lo:103: 00000100:00100000:1.0:1787548626.172779:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431846400:0@lo:103: 00000100:00100000:1.0:1787548626.172787:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431846272:0@lo:103: 00000100:00100000:1.0:1787548626.172814:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431846144:0@lo:103: 00000100:00100000:1.0:1787548626.172821:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431846016:0@lo:103: 00010000:00010000:1.0:1787548626.172835:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548626.172837:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548626.173190:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548626.173223:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548626.173251:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416094336 00000100:00100000:0.0:1787548626.173257:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416094336 00010000:00010000:0.0:1787548626.173282:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec813f7600/0xcb7c48919424e7bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20d1 expref: 10 pid: 5846 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548626.173298:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416094464 00000100:00100000:0.0:1787548626.173301:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416094464 00010000:00010000:0.0:1787548626.173313:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec813f6000/0xcb7c48919424e7b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20ca expref: 11 pid: 5846 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548626.173325:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00100000:0.0:1787548626.173331:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:450a7108-39f6-4004-8f60-5d2336e0cad2+11:2352:x1874380416094336:12345-192.168.206.13@tcp:103: 00010000:00010000:0.0:1787548626.173350:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548626.173356:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec813f7600/0xcb7c48919424e7bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20d1 expref: 11 pid: 5846 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.173367:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec813f7600/0xcb7c48919424e7bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20d1 expref: 11 pid: 5846 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.173379:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548626.173418:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:450a7108-39f6-4004-8f60-5d2336e0cad2+11:2352:x1874380416094336:12345-192.168.206.13@tcp:103: Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548626.173425:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00100000:0.0:1787548626.173458:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 19 00000100:00100000:0.0:1787548626.173465:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad281880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2352:x1874380416094464:12345-192.168.206.13@tcp:103: 00010000:00010000:0.0:1787548626.173473:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548626.173477:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec813f6000/0xcb7c48919424e7b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20ca expref: 10 pid: 5846 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.173487:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec813f6000/0xcb7c48919424e7b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20ca expref: 10 pid: 5846 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.173495:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548626.173513:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad281880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2352:x1874380416094464:12345-192.168.206.13@tcp:103: Request processed in 48us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548626.173534:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 19 00010000:00010000:3.0:1787548626.174443:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec813f7600/0xcb7c48919424e7bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20d1 expref: 9 pid: 5846 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.174457:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431844608:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548626.174467:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec813f6000/0xcb7c48919424e7b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20ca expref: 8 pid: 5846 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548626.174476:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874380431844736:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548626.174511:0:8446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548626.174917:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e6f1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548626.174940:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150400 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:2.0:1787548626.174944:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e6f1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548626.174952:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e6f1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787548626.174959:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e6f1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548626.174965:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787548626.175062:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e6f1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548626.175070:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787548626.175094:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e6f1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548626.175102:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec90150400/0xcb7c48919424e6ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e6f1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548626.175116:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548626.175118:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548626.175120:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548626.175216:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431846528:0@lo:103: 00000100:00100000:0.0:1787548626.175275:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548626.175322:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431846528 00000100:00100000:0.0:1787548626.175333:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431846528 00010000:00010000:0.0:1787548626.175355:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e6f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e6ea expref: 13 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548626.175388:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787548626.175396:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad282300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+13:3315:x1874380431846528:12345-0@lo:103: 00010000:00010000:0.0:1787548626.175406:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548626.175412:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e6f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e6ea expref: 13 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.175423:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e6ea expref: 13 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.175435:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e6f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e6ea expref: 13 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.175448:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.175456:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.175469:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.175476:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.175482:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.175488:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.175500:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec81534400 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548626.175504:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.175512:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.175540:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548626.175550:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548626.175595:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad282300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:3315:x1874380431846528:12345-0@lo:103: Request processed in 199us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548626.175603:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787548626.175646:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431846528:0@lo:103: 00010000:00010000:3.0:1787548626.176544:0:8446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.176556:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548626.176563:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec81534400/0xcb7c48919424e7f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548626.376084:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548627.382875:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548627.382966:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416094592 00000100:00100000:0.0:1787548627.382975:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416094592 00000100:00100000:0.0:1787548627.383026:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 130 00000100:00100000:0.0:1787548627.383034:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+8:5595:x1874380416094592:12345-192.168.206.13@tcp:101: 00010000:00010000:0.0:1787548627.383048:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548627.383065:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90151a00/0xcb7c48919424e7fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2133 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.383089:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90151a00/0xcb7c48919424e7fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2133 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.383098:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90151a00/0xcb7c48919424e7fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2133 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.383124:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151a00, rc 0) 00000100:00100000:0.0:1787548627.383198:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+9:5595:x1874380416094592:12345-192.168.206.13@tcp:101: Request processed in 165us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548627.383205:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 130 00000100:00100000:0.0:1787548627.384975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548627.385050:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416094720 00000100:00100000:2.0:1787548627.385057:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416094720 00000100:00100000:2.0:1787548627.385098:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 131 00000100:00100000:2.0:1787548627.385118:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+9:5595:x1874380416094720:12345-192.168.206.13@tcp:501: 00000100:00100000:2.0:1787548627.385438:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+9:5595:x1874380416094720:12345-192.168.206.13@tcp:501: Request processed in 319us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548627.385446:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 131 00000100:00100000:2.0:1787548627.387873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548627.388762:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416094848 00000100:00100000:1.0:1787548627.388772:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416094848 00000100:00100000:1.0:1787548627.388886:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 132 00000100:00100000:1.0:1787548627.388897:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+9:5595:x1874380416094848:12345-192.168.206.13@tcp:503: 00000100:00100000:1.0:1787548627.389445:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+9:5595:x1874380416094848:12345-192.168.206.13@tcp:503: Request processed in 548us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548627.389454:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 132 00010000:00010000:0.0:1787548627.395351:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548627.398350:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548627.398515:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416094976 00000100:00100000:0.0:1787548627.398525:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416094976 00000100:00100000:0.0:1787548627.398579:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 133 00000100:00100000:0.0:1787548627.398589:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+9:6069:x1874380416094976:12345-192.168.206.13@tcp:502: 00000100:00100000:0.0:1787548627.398860:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+9:6069:x1874380416094976:12345-192.168.206.13@tcp:502: Request processed in 269us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548627.398867:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 133 00000100:00100000:0.0:1787548627.400864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548627.400955:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416095104 00000100:00100000:1.0:1787548627.400973:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416095104 00000100:00100000:1.0:1787548627.401057:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 134 00000100:00100000:1.0:1787548627.401067:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+9:6069:x1874380416095104:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787548627.401561:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+9:6069:x1874380416095104:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 494us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548627.401570:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 134 00000100:00100000:3.0:1787548627.404814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548627.410294:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416095232 00000100:00100000:0.0:1787548627.410310:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416095232 00000100:00100000:0.0:1787548627.410460:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 135 00000100:00100000:0.0:1787548627.410473:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+9:5595:x1874380416095232:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787548627.410500:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548627.410520:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90151800/0xcb7c48919424e802 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a213a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.410550:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90151800/0xcb7c48919424e802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a213a expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.410562:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90151800/0xcb7c48919424e802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a213a expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.410584:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151800, rc 0) 00000100:00100000:0.0:1787548627.410648:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5595:x1874380416095232:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 Request processed in 178us (5842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548627.410656:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 135 00000100:00100000:3.0:1787548627.417684:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548627.418230:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416095360 00000100:00100000:0.0:1787548627.418251:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416095360 00000100:00100000:0.0:1787548627.418309:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 136 00000100:00100000:0.0:1787548627.418319:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5595:x1874380416095360:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787548627.418975:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5595:x1874380416095360:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 Request processed in 655us (1298us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787548627.418984:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 136 00000100:00100000:1.0:1787548627.459306:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431846912:0@lo:400: 00000100:00100000:3.0:1787548627.459323:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431847168:0@lo:400: 00000100:00100000:2.0:1787548627.459415:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431846784:0@lo:13: 00000100:00100000:0.0:1787548627.459494:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431847040:0@lo:400: 00000100:00100000:3.0:1787548627.460757:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.460905:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431847168 00000100:00100000:3.0:1787548627.460913:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431847168 00000100:00100000:3.0:1787548627.460966:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787548627.460976:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431847168:12345-0@lo:400: 00000100:00100000:3.0:1787548627.461029:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431847168:12345-0@lo:400: Request processed in 54us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548627.461037:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787548627.461056:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787548627.461084:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec90095180 x1874380431847168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548627.461270:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431847168:0@lo:400: 00000100:00100000:1.0:1787548627.462038:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548627.462072:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548627.462078:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431847424:0@lo:400: 00000100:00100000:2.0:1787548627.462115:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431846656:0@lo:400: 00000100:00100000:1.0:1787548627.462120:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548627.462160:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548627.462171:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431847424 00000100:00100000:1.0:1787548627.462176:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431847424 00000100:00100000:2.0:1787548627.462179:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431847296:0@lo:400: 00000100:00100000:2.0:1787548627.462200:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548627.462226:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431846656 00000100:00100000:1.0:1787548627.462227:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787548627.462229:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431846656 00000100:00100000:1.0:1787548627.462245:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431847424:12345-0@lo:400: 00000100:00100000:2.0:1787548627.462263:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787548627.462269:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:3316:x1874380431846656:12345-0@lo:400: 00000100:00100000:1.0:1787548627.462282:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431847424:12345-0@lo:400: Request processed in 38us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548627.462288:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787548627.462297:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+12:3316:x1874380431846656:12345-0@lo:400: Request processed in 29us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548627.462303:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1787548627.462303:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787548627.462322:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec90096680 x1874380431847424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548627.462330:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431846656:0@lo:400: 00000100:00100000:1.0:1787548627.462333:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431847424:0@lo:400: 00000100:00100000:1.0:1787548627.462360:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431846784 00000100:00100000:1.0:1787548627.462364:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431846784 00000100:00100000:1.0:1787548627.462387:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787548627.462394:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431846784:12345-0@lo:13: 00002000:00000024:1.0:1787548627.462418:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548627.462451:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431846784:12345-0@lo:13: Request processed in 57us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548627.462458:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787548627.462485:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431846912 00000100:00100000:1.0:1787548627.462489:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431846912 00000100:00100000:1.0:1787548627.462510:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431847296 00000100:00100000:1.0:1787548627.462513:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431847296 00010000:00080000:2.0:1787548627.462521:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecbd060380 x1874380431846784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548627.462530:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787548627.462536:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431846784:0@lo:13: 00000100:00100000:1.0:1787548627.462536:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431846912:12345-0@lo:400: 00000100:00100000:2.0:1787548627.462561:0:5855:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787548627.462568:0:5855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787548627.462568:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431846912:12345-0@lo:400: Request processed in 33us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548627.462580:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787548627.462592:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787548627.462597:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431847296:12345-0@lo:400: 00000100:00100000:1.0:1787548627.462644:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431847296:12345-0@lo:400: Request processed in 47us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548627.462649:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1787548627.462662:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787548627.462677:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431846912:0@lo:400: 00000100:00100000:2.0:1787548627.462698:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431847296:0@lo:400: 00000100:00100000:0.0:1787548627.463077:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548627.463281:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431847552:0@lo:13: 00000100:00100000:0.0:1787548627.463309:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.463727:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431847552 00000100:00100000:3.0:1787548627.463733:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431847552 00000100:00100000:3.0:1787548627.463769:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787548627.463777:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431847552:12345-0@lo:13: 00002000:00000024:3.0:1787548627.463812:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548627.463849:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431847552:12345-0@lo:13: Request processed in 72us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548627.463855:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787548627.463978:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecad282a00 x1874380431847552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548627.463993:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431847552:0@lo:13: 00000100:00100000:2.0:1787548627.464042:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431847040 00000100:00100000:2.0:1787548627.464047:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431847040 00000100:00100000:2.0:1787548627.464262:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787548627.464270:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431847040:12345-0@lo:400: 00000100:00100000:2.0:1787548627.464313:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431847040:12345-0@lo:400: Request processed in 44us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548627.464320:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787548627.464578:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548627.464602:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431847040:0@lo:400: 10000000:01000000:3.0:1787548627.843242:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787548627.843250:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fec88445800 from 39 10000000:01000000:3.0:1787548627.843255:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787548627.843301:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.843326:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.843338:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548627.843362:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431847680:0@lo:101: 00000100:00100000:3.0:1787548627.843426:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.843552:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787548627.843637:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431847680 00000100:00100000:0.0:1787548627.843646:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431847680 00000100:00100000:0.0:1787548627.843689:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787548627.843699:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+12:5851:x1874380431847680:12345-0@lo:101: 00010000:00010000:0.0:1787548627.843719:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548627.843731:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90150a00/0xcb7c48919424e810 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e809 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.843751:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90150a00/0xcb7c48919424e810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e809 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.843762:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90150a00/0xcb7c48919424e810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e809 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.843771:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150a00, rc 0) 00000100:00100000:0.0:1787548627.843819:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+13:5851:x1874380431847680:12345-0@lo:101: Request processed in 122us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548627.843825:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787548627.843935:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431847680:0@lo:101: 00010000:00010000:3.0:1787548627.843950:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e810 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.843959:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e810 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548627.844008:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431847808:0@lo:501: 00000100:00100000:3.0:1787548627.844033:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.844055:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1600 going to sleep for 11 seconds 00000100:00100000:1.0:1787548627.844106:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431847808 00000100:00100000:1.0:1787548627.844111:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431847808 00000100:00100000:1.0:1787548627.844159:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787548627.844167:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+13:5851:x1874380431847808:12345-0@lo:501: 00000100:00100000:1.0:1787548627.844414:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+13:5851:x1874380431847808:12345-0@lo:501: Request processed in 248us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548627.844421:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787548627.844526:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431847808:0@lo:501: 00000100:00100000:3.0:1787548627.844555:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431847936:0@lo:503: 00000100:00100000:3.0:1787548627.844592:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548627.844649:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431847936 00000100:00100000:1.0:1787548627.844654:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431847936 00000100:00100000:1.0:1787548627.844682:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787548627.844689:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+13:5851:x1874380431847936:12345-0@lo:503: 00000100:00100000:1.0:1787548627.844818:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+13:5851:x1874380431847936:12345-0@lo:503: Request processed in 129us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548627.844824:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787548627.848379:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787548627.848422:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431847936:0@lo:503: 00000100:00100000:0.0:1787548627.848986:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8468:1874380431848064:0@lo:502: 00000100:00100000:0.0:1787548627.849055:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548627.849093:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec88381600 going to sleep for 11 seconds 00000100:00100000:1.0:1787548627.849175:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431848064 00000100:00100000:1.0:1787548627.849181:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431848064 00000100:00100000:1.0:1787548627.849238:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787548627.849249:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+13:8468:x1874380431848064:12345-0@lo:502: 00000100:00100000:1.0:1787548627.849489:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+13:8468:x1874380431848064:12345-0@lo:502: Request processed in 241us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548627.849497:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787548627.849627:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8468:1874380431848064:0@lo:502: 00000100:00100000:2.0:1787548627.849676:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8468:1874380431848192:0@lo:502: 00000100:00100000:2.0:1787548627.849706:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548627.849737:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9007b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787548627.849783:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431848192 00000100:00100000:0.0:1787548627.849788:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431848192 00000100:00100000:0.0:1787548627.849816:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787548627.849823:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+13:8468:x1874380431848192:12345-0@lo:502: 00000100:00100000:0.0:1787548627.849983:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+13:8468:x1874380431848192:12345-0@lo:502: Request processed in 159us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548627.849990:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787548627.850217:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8468:1874380431848192:0@lo:502: 00000040:00080000:2.0:1787548627.850248:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787548627.850395:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787548627.850421:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787548627.850430:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e810 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.850440:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e810 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548627.850449:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787548627.850452:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787548627.850455:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787548627.850476:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.850484:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.850492:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548627.850507:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431848320:0@lo:101: 00000100:00100000:3.0:1787548627.850534:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.851504:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787548627.855563:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431848320 00000100:00100000:0.0:1787548627.855577:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431848320 00000100:00100000:0.0:1787548627.855640:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787548627.855650:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+13:5851:x1874380431848320:12345-0@lo:101: 00010000:00010000:0.0:1787548627.855678:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548627.855696:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90151e00/0xcb7c48919424e81e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e817 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.855722:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90151e00/0xcb7c48919424e81e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e817 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.855733:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90151e00/0xcb7c48919424e81e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e817 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.855742:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151e00, rc 0) 00000100:00100000:0.0:1787548627.855909:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431848320:12345-0@lo:101: Request processed in 260us (5371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548627.855918:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787548627.856081:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431848320:0@lo:101: 00010000:00010000:3.0:1787548627.856101:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e81e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.856112:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e81e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548627.856317:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431848448:0@lo:501: 00000100:00100000:3.0:1787548627.856360:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.856436:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1600 going to sleep for 11 seconds 00000100:00100000:1.0:1787548627.856473:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431848448 00000100:00100000:1.0:1787548627.856478:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431848448 00000100:00100000:1.0:1787548627.856538:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787548627.856546:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431848448:12345-0@lo:501: 00000100:00100000:1.0:1787548627.856829:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431848448:12345-0@lo:501: Request processed in 283us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548627.856837:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787548627.856930:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431848448:0@lo:501: 00000100:00100000:3.0:1787548627.856960:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431848576:0@lo:503: 00000100:00100000:3.0:1787548627.856998:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.857058:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787548627.857096:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431848576 00000100:00100000:0.0:1787548627.857101:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431848576 00000100:00100000:0.0:1787548627.857196:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787548627.857204:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431848576:12345-0@lo:503: 00000100:00100000:0.0:1787548627.857370:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431848576:12345-0@lo:503: Request processed in 165us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548627.857377:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787548627.857443:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431848576:0@lo:503: 00000100:00100000:3.0:1787548627.857651:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8469:1874380431848704:0@lo:502: 00000100:00100000:3.0:1787548627.857686:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.857917:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787548627.857994:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431848704 00000100:00100000:2.0:1787548627.858000:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431848704 00000100:00100000:2.0:1787548627.858025:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787548627.858032:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:8469:x1874380431848704:12345-0@lo:502: 00000100:00100000:2.0:1787548627.858215:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:8469:x1874380431848704:12345-0@lo:502: Request processed in 183us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548627.858224:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787548627.858328:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8469:1874380431848704:0@lo:502: 00000020:01000000:3.0:1787548627.858352:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787548627.858360:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548627.858362:0:8469:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787548627.858368:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787548627.858388:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8469:1874380431848832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548627.858422:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.858451:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787548627.858498:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431848832 00000100:00100000:2.0:1787548627.858503:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431848832 00000100:00100000:2.0:1787548627.858520:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787548627.858527:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:8469:x1874380431848832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787548627.858690:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:8469:x1874380431848832:12345-0@lo:502:llog_process_th.0 Request processed in 162us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548627.858705:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787548627.858853:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8469:1874380431848832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787548627.858873:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787548627.858877:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548627.858879:0:8469:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787548627.858883:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787548627.859044:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787548627.859061:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787548627.859070:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e81e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.859080:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e81e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548627.859101:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787548627.859103:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fecad08a800 from 39 10000000:01000000:0.0:1787548627.859106:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787548627.859258:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.859268:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.859278:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548627.859295:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad280a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431848960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787548627.859329:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548627.859390:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec988b7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787548627.859502:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431848960 00000100:00100000:2.0:1787548627.859507:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431848960 00000100:00100000:2.0:1787548627.859582:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787548627.859590:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+14:5851:x1874380431848960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548627.859600:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548627.859611:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecc21ece00/0xcb7c48919424e82c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e825 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548627.859631:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecc21ece00/0xcb7c48919424e82c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e825 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548627.859640:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecc21ece00/0xcb7c48919424e82c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e825 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548627.859649:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ece00, rc 0) 00000100:00100000:2.0:1787548627.859692:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431848960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548627.859698:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787548627.859753:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad280a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431848960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787548627.859766:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.859781:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548627.859824:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431849088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548627.859849:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.859947:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787548627.860015:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431849088 00000100:00100000:0.0:1787548627.860019:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431849088 00000100:00100000:0.0:1787548627.860040:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787548627.860047:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431849088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787548627.860300:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431849088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548627.860308:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787548627.860391:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431849088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548627.860419:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431849216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787548627.860455:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.860477:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787548627.860525:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431849216 00000100:00100000:0.0:1787548627.860530:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431849216 00000100:00100000:0.0:1787548627.860549:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787548627.860555:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431849216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787548627.860693:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431849216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548627.860707:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787548627.860778:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431849216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787548627.861195:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8470:1874380431849344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548627.861246:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.861277:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1840 going to sleep for 11 seconds 00000100:00100000:0.0:1787548627.861359:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431849344 00000100:00100000:0.0:1787548627.861364:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431849344 00000100:00100000:0.0:1787548627.861397:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787548627.861405:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+15:8470:x1874380431849344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787548627.861619:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+15:8470:x1874380431849344:12345-0@lo:502:llog_process_th.0 Request processed in 213us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548627.861626:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787548627.861800:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8470:1874380431849344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548627.861840:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8470:1874380431849472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548627.861873:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.861933:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1840 going to sleep for 11 seconds 00000100:00100000:0.0:1787548627.861962:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431849472 00000100:00100000:0.0:1787548627.861966:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431849472 00000100:00100000:0.0:1787548627.862025:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787548627.862033:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+15:8470:x1874380431849472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787548627.862302:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+15:8470:x1874380431849472:12345-0@lo:502:llog_process_th.0 Request processed in 269us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548627.862309:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787548627.862374:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8470:1874380431849472:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787548627.862395:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787548627.862546:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787548627.862569:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787548627.862577:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.862587:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548627.862595:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787548627.862597:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787548627.862600:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787548627.862621:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.862634:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.862644:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548627.862658:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431849600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787548627.862687:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548627.862754:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8640db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787548627.862794:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431849600 00000100:00100000:1.0:1787548627.862799:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431849600 00000100:00100000:1.0:1787548627.862868:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787548627.862876:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+15:5851:x1874380431849600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787548627.862885:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548627.862897:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbd22e200/0xcb7c48919424e83a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e833 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548627.862916:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbd22e200/0xcb7c48919424e83a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e833 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548627.862925:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbd22e200/0xcb7c48919424e83a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e833 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548627.862934:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22e200, rc 0) 00000100:00100000:1.0:1787548627.862973:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431849600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548627.862978:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787548627.863046:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431849600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787548627.863059:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e83a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548627.863068:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e83a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548627.863110:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431849728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787548627.863166:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548627.863568:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8640db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787548627.863624:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431849728 00000100:00100000:2.0:1787548627.863629:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431849728 00000100:00100000:2.0:1787548627.863653:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787548627.863659:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431849728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548627.863897:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431849728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548627.863904:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787548627.863979:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431849728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787548627.864010:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431849856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787548627.864047:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548627.864100:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8640db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787548627.864216:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431849856 00000100:00100000:2.0:1787548627.864227:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431849856 00000100:00100000:2.0:1787548627.864259:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787548627.864266:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431849856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787548627.864391:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431849856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548627.864398:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787548627.864473:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431849856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548627.864830:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8471:1874380431849984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548627.864868:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548627.864899:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecb52bc600 going to sleep for 11 seconds 00000100:00100000:2.0:1787548627.864946:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431849984 00000100:00100000:2.0:1787548627.864950:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431849984 00000100:00100000:2.0:1787548627.864980:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787548627.864987:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+16:8471:x1874380431849984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787548627.865227:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+16:8471:x1874380431849984:12345-0@lo:502:llog_process_th.0 Request processed in 240us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548627.865245:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787548627.865359:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8471:1874380431849984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787548627.865385:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787548627.865393:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548627.865395:0:8471:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787548627.865400:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787548627.865417:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8471:1874380431850112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787548627.865448:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548627.865508:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8640db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787548627.865545:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431850112 00000100:00100000:1.0:1787548627.865549:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431850112 00000100:00100000:1.0:1787548627.865607:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787548627.865615:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+16:8471:x1874380431850112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548627.865748:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+16:8471:x1874380431850112:12345-0@lo:502:llog_process_th.0 Request processed in 133us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548627.865755:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787548627.865817:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8471:1874380431850112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787548627.865835:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787548627.865839:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548627.865840:0:8471:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787548627.865843:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1787548627.865974:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787548627.865993:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787548627.866006:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e83a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.866017:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e83a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548627.866026:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787548627.866029:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fec8644c800 from 39 10000000:01000000:3.0:1787548627.866032:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787548627.866053:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.866061:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.866070:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548627.866083:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431850240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787548627.866111:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.866294:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787548627.866343:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431850240 00000100:00100000:2.0:1787548627.866348:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431850240 00000100:00100000:2.0:1787548627.866372:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787548627.866379:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431850240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548627.866387:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548627.866399:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecc21ec800/0xcb7c48919424e848 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e841 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548627.866419:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecc21ec800/0xcb7c48919424e848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e841 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548627.866430:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecc21ec800/0xcb7c48919424e848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e841 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548627.866439:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ec800, rc 0) 00000100:00100000:2.0:1787548627.866485:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431850240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548627.866492:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787548627.866553:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431850240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787548627.866566:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.866574:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548627.866616:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431850368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548627.866650:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.866671:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787548627.866730:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431850368 00000100:00100000:2.0:1787548627.866735:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431850368 00000100:00100000:2.0:1787548627.866753:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787548627.866759:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431850368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548627.866949:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431850368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548627.866956:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787548627.867074:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431850368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548627.867099:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431850496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787548627.867363:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.867383:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787548627.867430:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431850496 00000100:00100000:2.0:1787548627.867435:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431850496 00000100:00100000:2.0:1787548627.867453:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787548627.867459:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431850496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787548627.867600:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431850496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548627.867607:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787548627.867676:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431850496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787548627.868012:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8472:1874380431850624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548627.868050:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.868155:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787548627.868342:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431850624 00000100:00100000:1.0:1787548627.868348:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431850624 00000100:00100000:1.0:1787548627.868376:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787548627.868383:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+17:8472:x1874380431850624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548627.868575:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+17:8472:x1874380431850624:12345-0@lo:502:llog_process_th.0 Request processed in 191us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548627.868583:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787548627.868669:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8472:1874380431850624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548627.868710:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8472:1874380431850752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548627.868746:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.868776:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787548627.868826:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431850752 00000100:00100000:1.0:1787548627.868831:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431850752 00000100:00100000:1.0:1787548627.868851:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787548627.868857:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+17:8472:x1874380431850752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548627.869004:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+17:8472:x1874380431850752:12345-0@lo:502:llog_process_th.0 Request processed in 146us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548627.869012:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787548627.869090:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8472:1874380431850752:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787548627.869111:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787548627.869321:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787548627.869341:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787548627.869351:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548627.869369:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548627.869379:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787548627.869382:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787548627.869386:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787548627.869408:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548627.869416:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548627.869425:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548627.869439:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431850880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787548627.869469:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548627.869501:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecb52bc180 going to sleep for 11 seconds 00000100:00100000:3.0:1787548627.869552:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431850880 00000100:00100000:3.0:1787548627.869557:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431850880 00000100:00100000:3.0:1787548627.869578:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787548627.869584:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431850880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787548627.869592:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548627.869603:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec81534000/0xcb7c48919424e856 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e84f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.869633:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec81534000/0xcb7c48919424e856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e84f expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.869644:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec81534000/0xcb7c48919424e856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e84f expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.869652:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec81534000, rc 0) 00000100:00100000:3.0:1787548627.869690:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431850880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548627.869697:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787548627.869765:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431850880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787548627.869777:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548627.869786:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548627.869830:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431851008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787548627.869856:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548627.869888:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecb52bc180 going to sleep for 11 seconds 00000100:00100000:3.0:1787548627.869938:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431851008 00000100:00100000:3.0:1787548627.869943:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431851008 00000100:00100000:3.0:1787548627.869962:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787548627.869968:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431851008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548627.870219:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431851008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548627.870225:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787548627.870306:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431851008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787548627.870333:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431851136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548627.870369:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548627.870397:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecb52bc180 going to sleep for 11 seconds 00000100:00100000:3.0:1787548627.870445:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431851136 00000100:00100000:3.0:1787548627.870449:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431851136 00000100:00100000:3.0:1787548627.870468:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787548627.870475:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431851136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787548627.870607:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431851136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548627.870614:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787548627.870688:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431851136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548627.870994:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8473:1874380431851264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548627.871027:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548627.871049:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecb52bc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787548627.871096:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431851264 00000100:00100000:3.0:1787548627.871100:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431851264 00000100:00100000:3.0:1787548627.871158:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787548627.871165:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:8473:x1874380431851264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548627.871323:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:8473:x1874380431851264:12345-0@lo:502:llog_process_th.0 Request processed in 158us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548627.871331:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787548627.871549:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8473:1874380431851264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787548627.871572:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548627.871581:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548627.871584:0:8473:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787548627.871588:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787548627.871607:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8473:1874380431851392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548627.871641:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548627.871668:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecb52bc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787548627.871714:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431851392 00000100:00100000:3.0:1787548627.871719:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431851392 00000100:00100000:3.0:1787548627.871739:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787548627.871745:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:8473:x1874380431851392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548627.871885:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:8473:x1874380431851392:12345-0@lo:502:llog_process_th.0 Request processed in 139us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548627.871892:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787548627.871963:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8473:1874380431851392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787548627.871981:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548627.871985:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548627.871987:0:8473:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787548627.871990:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787548627.872122:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1787548627.872174:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787548627.872183:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.872194:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548627.872203:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787548627.872205:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fec87eab370 from 1 10000000:01000000:3.0:1787548627.872208:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787548627.872238:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81535600/0xcb7c48919424e85d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.872246:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec81535600/0xcb7c48919424e85d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.872266:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec81535600/0xcb7c48919424e85d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548627.872280:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431851520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787548627.872307:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.872321:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787548627.872333:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431851520 00000100:00100000:3.0:1787548627.872336:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431851520 00000100:00100000:3.0:1787548627.872353:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787548627.872359:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431851520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787548627.872366:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548627.872377:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec81534c00/0xcb7c48919424e864 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e85d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.872393:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec81534c00/0xcb7c48919424e864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e85d expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.872402:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec81534c00/0xcb7c48919424e864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e85d expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.872410:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec81534c00, rc 0) 00000100:00100000:3.0:1787548627.872436:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431851520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548627.872442:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787548627.872467:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431851520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787548627.872477:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec81535600/0xcb7c48919424e85d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e864 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.872493:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec81535600/0xcb7c48919424e85d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e864 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548627.872533:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431851648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548627.872554:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548627.872565:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787548627.872575:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431851648 00000100:00100000:3.0:1787548627.872578:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431851648 00000100:00100000:3.0:1787548627.872593:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787548627.872598:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431851648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548627.872769:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431851648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (213us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787548627.872776:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787548627.872804:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431851648:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787548627.872821:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787548627.872826:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81535600/0xcb7c48919424e85d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e864 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548627.872834:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec81535600/0xcb7c48919424e85d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e864 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548628.027352:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548628.027403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548628.027423:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416095488 00000100:00100000:2.0:1787548628.027434:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416095488 00000100:00100000:3.0:1787548628.027449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548628.027502:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 28 00000100:00100000:1.0:1787548628.027512:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416095744 00000100:00100000:2.0:1787548628.027513:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2354:x1874380416095488:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548628.027517:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416095744 00000100:00100000:1.0:1787548628.027554:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416095616 00000100:00100000:1.0:1787548628.027557:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416095616 00000100:00100000:1.0:1787548628.027573:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:2.0:1787548628.027586:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2354:x1874380416095488:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 75us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548628.027592:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2354:x1874380416095744:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548628.027593:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 28 00000100:00100000:1.0:1787548628.027618:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2354:x1874380416095744:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 27us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548628.027624:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:1.0:1787548628.027636:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 15 00000100:00100000:1.0:1787548628.027641:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2354:x1874380416095616:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548628.027662:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2354:x1874380416095616:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 21us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548628.027667:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 15 00000100:00080000:1.0:1787548628.027684:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787548628.027688:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787548628.027690:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787548628.420992:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787548629.406912:0:8511:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4992f790 20000000:00000080:2.0:1787548629.406929:0:8511:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fecb44d6c00 uarg=0000000000000000 20000000:01000000:2.0:1787548629.406968:0:8511:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787548629.406974:0:8511:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787548629.406979:0:8511:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787548629.409820:0:8512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787548629.409972:0:8511:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787548629.414025:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787548629.414082:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787548629.414189:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787548629.414207:0:8511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787548629.414234:0:8511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.414252:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec813f7200/0xcb7c48919424e634 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e62d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.414259:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec813f6c00/0xcb7c48919424e6b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e6ab expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.414266:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec90151c00/0xcb7c48919424e70d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e706 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.414299:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec81534600/0xcb7c48919424e7ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2102 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.414576:0:8511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.414621:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec81534600/0xcb7c48919424e7ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2102 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.414638:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fec81534600/0xcb7c48919424e7ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2102 expref: 9 pid: 5848 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548629.414656:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874380431851776:192.168.206.13@tcp:104: 00010000:00010000:1.0:1787548629.414832:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec90151c00/0xcb7c48919424e70d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e706 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.414842:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fec90151c00/0xcb7c48919424e70d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e706 expref: 18 pid: 5849 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548629.414852:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd061880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874380431851904:0@lo:104: 00000100:00100000:1.0:1787548629.414894:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787548629.414939:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec813f6c00/0xcb7c48919424e6b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e6ab expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.414948:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fec813f6c00/0xcb7c48919424e6b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e6ab expref: 18 pid: 5848 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548629.414957:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd060700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874380431852032:0@lo:104: 00000100:00100000:1.0:1787548629.414997:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548629.415038:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787548629.415050:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431851904 00000100:00100000:1.0:1787548629.415057:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431851904 00000100:00100000:1.0:1787548629.415095:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431852032 00000100:00100000:1.0:1787548629.415098:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431852032 00000100:00100000:1.0:1787548629.415127:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787548629.415162:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+4:8511:x1874380431851904:12345-0@lo:104: 00010000:00010000:1.0:1787548629.415177:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e70d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.415234:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787548629.415240:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+4:8511:x1874380431851904:12345-0@lo:104: Request processed in 80us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548629.415246:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787548629.415265:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787548629.415271:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad55b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:8511:x1874380431852032:12345-0@lo:104: 00010000:00010000:1.0:1787548629.415279:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e6b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.415427:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548629.415434:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e70d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.415442:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec400 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:2.0:1787548629.415447:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e70d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.415456:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e70d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787548629.415464:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e70d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548629.415471:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787548629.415502:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e70d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.415509:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787548629.415529:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e70d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.415537:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecc21ec400/0xcb7c48919424e706 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e70d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.415551:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548629.415553:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548629.415562:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548629.415572:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787548629.415584:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431852160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787548629.415616:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787548629.416521:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787548629.416532:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad55b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:8511:x1874380431852032:12345-0@lo:104: Request processed in 1260us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548629.416541:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787548629.416606:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec813f7200/0xcb7c48919424e634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e62d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.416618:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fec813f7200/0xcb7c48919424e634 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e62d expref: 18 pid: 5846 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548629.416644:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd060a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874380431852288:0@lo:104: 00000100:00100000:1.0:1787548629.416681:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548629.416698:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd4b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787548629.416717:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd061880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874380431851904:0@lo:104: 00000100:00100000:1.0:1787548629.416726:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd060700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874380431852032:0@lo:104: 00000100:00100000:1.0:1787548629.417556:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431852160 00000100:00100000:1.0:1787548629.417567:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431852160 00010000:00010000:1.0:1787548629.417599:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec90151c00/0xcb7c48919424e70d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e706 expref: 19 pid: 5849 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548629.417627:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787548629.417634:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3316:x1874380431852160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787548629.417645:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548629.417650:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec90151c00/0xcb7c48919424e70d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e706 expref: 19 pid: 5849 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.417659:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec90151c00/0xcb7c48919424e70d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e706 expref: 19 pid: 5849 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.417690:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec90151c00/0xcb7c48919424e70d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e706 expref: 19 pid: 5849 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.417705:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548629.417749:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3418829f-2e19-44b5-ae62-1256ac42dc62+18:3316:x1874380431852160:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548629.417754:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787548629.418215:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548629.418233:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e6b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.418241:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec80030000 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:2.0:1787548629.418245:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e6b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.418254:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e6b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787548629.418261:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e6b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548629.418266:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787548629.418293:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e6b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.418299:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787548629.418322:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e6b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.418329:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec80030000/0xcb7c48919424e6ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e6b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.418344:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548629.418346:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548629.418359:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548629.418501:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431852288 00000100:00100000:2.0:1787548629.418506:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431852288 00000100:00100000:2.0:1787548629.418543:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787548629.418552:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+3:8511:x1874380431852288:12345-0@lo:104: 00010000:00010000:2.0:1787548629.418563:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e62d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e634 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.418641:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787548629.418647:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+3:8511:x1874380431852288:12345-0@lo:104: Request processed in 97us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548629.418654:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787548629.418750:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431852416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787548629.418785:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548629.418819:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431852160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787548629.419215:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548629.419231:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e62d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e634 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.419239:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec80031a00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:0.0:1787548629.419243:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e62d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e634 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.419250:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e62d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e634 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787548629.419257:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e62d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e634 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548629.419261:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787548629.419281:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e62d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e634 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.419299:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787548629.419329:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e62d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e634 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.419336:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e62d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e634 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.419351:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548629.419353:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548629.419355:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548629.419365:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431852416 00000100:00100000:0.0:1787548629.419369:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431852416 00010000:00010000:0.0:1787548629.419514:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec813f6c00/0xcb7c48919424e6b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e6ab expref: 18 pid: 5848 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548629.419538:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787548629.419545:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+18:3316:x1874380431852416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787548629.419554:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548629.419559:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec813f6c00/0xcb7c48919424e6b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e6ab expref: 18 pid: 5848 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.419568:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec813f6c00/0xcb7c48919424e6b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e6ab expref: 18 pid: 5848 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.419581:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec813f6c00/0xcb7c48919424e6b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e6ab expref: 18 pid: 5848 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.419592:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548629.419627:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+17:3316:x1874380431852416:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548629.419639:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787548629.419660:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431852544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787548629.419688:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548629.419727:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431852544 00000100:00100000:0.0:1787548629.419731:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431852544 00010000:00010000:0.0:1787548629.419745:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec813f7200/0xcb7c48919424e634 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e62d expref: 17 pid: 5846 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548629.419762:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787548629.419767:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad280a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3418829f-2e19-44b5-ae62-1256ac42dc62+17:3313:x1874380431852544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787548629.419773:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548629.419777:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec813f7200/0xcb7c48919424e634 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e62d expref: 17 pid: 5846 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.419784:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec813f7200/0xcb7c48919424e634 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e62d expref: 17 pid: 5846 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.419794:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548629.419819:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad280a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3418829f-2e19-44b5-ae62-1256ac42dc62+17:3313:x1874380431852544:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548629.419826:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787548629.419851:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431852544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787548629.419875:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431852416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787548629.421480:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec813f7200/0xcb7c48919424e634 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e62d expref: 16 pid: 5846 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548629.421515:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd060a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874380431852288:0@lo:104: 00000100:00100000:1.0:1787548629.423816:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874380431851776:192.168.206.13@tcp:104: 00010000:00010000:1.0:1787548629.423853:0:8511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548629.430927:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548629.431018:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416095872 00000100:00100000:0.0:1787548629.431027:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416095872 00010000:00010000:0.0:1787548629.431065:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec81534600/0xcb7c48919424e7ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2102 expref: 10 pid: 5848 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548629.431567:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 24 00000100:00100000:0.0:1787548629.431580:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2351:x1874380416095872:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548629.431597:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548629.431604:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec81534600/0xcb7c48919424e7ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2102 expref: 10 pid: 5848 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.431618:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec81534600/0xcb7c48919424e7ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2102 expref: 10 pid: 5848 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.431637:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec81534600/0xcb7c48919424e7ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2102 expref: 10 pid: 5848 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.431654:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.431663:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.431680:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.431688:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.431694:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.431701:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.431719:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f600 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548629.431724:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.431733:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.432050:0:8511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.432061:0:8511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.434971:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.434989:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424e86b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548629.435008:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548629.435453:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:450a7108-39f6-4004-8f60-5d2336e0cad2+9:2351:x1874380416095872:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 3870us (4529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548629.435465:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 24 00010000:00010000:1.0:1787548629.444508:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787548629.867653:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787548629.867664:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fec88445800 from 4 10000000:01000000:3.0:1787548629.867923:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787548629.867968:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548629.867981:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548629.867991:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548629.868014:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90097480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431852672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787548629.868076:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548629.868146:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1600 going to sleep for 11 seconds 00000100:00100000:1.0:1787548629.868207:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431852672 00000100:00100000:1.0:1787548629.868216:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431852672 00000100:00100000:1.0:1787548629.868282:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787548629.868292:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431852672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787548629.868306:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548629.868319:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbd22f800/0xcb7c48919424e879 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e872 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.868344:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbd22f800/0xcb7c48919424e879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e872 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.868354:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbd22f800/0xcb7c48919424e879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e872 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.868364:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22f800, rc 0) 00000100:00100000:1.0:1787548629.868413:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431852672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548629.868427:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787548629.868518:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90097480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431852672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548629.868533:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e879 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.868542:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e879 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548629.868597:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431852800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548629.868624:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548629.868657:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca0a1ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787548629.868713:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431852800 00000100:00100000:1.0:1787548629.868718:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431852800 00000100:00100000:1.0:1787548629.868748:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787548629.868755:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431852800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787548629.868987:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431852800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548629.868995:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787548629.869073:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431852800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548629.869106:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431852928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787548629.869166:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548629.869191:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca0a1ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787548629.869258:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431852928 00000100:00100000:1.0:1787548629.869263:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431852928 00000100:00100000:1.0:1787548629.869296:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787548629.869303:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431852928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548629.869440:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431852928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548629.869447:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787548629.869483:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431852928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548629.869673:0:8525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8525:1874380431853056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548629.869706:0:8525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548629.869725:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431853056 00000100:00100000:1.0:1787548629.869729:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431853056 00000100:00100000:1.0:1787548629.869747:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787548629.869753:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:8525:x1874380431853056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548629.869872:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:8525:x1874380431853056:12345-0@lo:502:llog_process_th.0 Request processed in 118us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548629.869888:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787548629.869924:0:8525:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd4b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787548629.869936:0:8525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8525:1874380431853056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787548629.869957:0:8525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548629.869974:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548629.869976:0:8525:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787548629.869983:0:8525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fec88445800 00000020:00000080:1.0:1787548629.869985:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787548629.870048:0:8525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8525:1874380431853184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548629.870084:0:8525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548629.870102:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431853184 00000100:00100000:1.0:1787548629.870106:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431853184 00000100:00100000:1.0:1787548629.870123:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787548629.870155:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:8525:x1874380431853184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548629.870274:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:8525:x1874380431853184:12345-0@lo:502:llog_process_th.0 Request processed in 144us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548629.870280:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787548629.870307:0:8525:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd4b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787548629.870319:0:8525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8525:1874380431853184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787548629.870337:0:8525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548629.870342:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548629.870343:0:8525:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787548629.870347:0:8525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787548629.870399:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787548629.870414:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787548629.870423:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e879 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.870438:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e879 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548629.870448:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787548629.870451:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fecad08a800 from 4 10000000:01000000:1.0:1787548629.870453:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787548629.870474:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.870482:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.870491:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548629.870504:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431853312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787548629.870531:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548629.870544:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd4b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787548629.870555:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431853312 00000100:00100000:1.0:1787548629.870558:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431853312 00000100:00100000:1.0:1787548629.870576:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787548629.870582:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431853312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787548629.870589:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548629.870599:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbd22fa00/0xcb7c48919424e887 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e880 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.870616:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbd22fa00/0xcb7c48919424e887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e880 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.870638:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbd22fa00/0xcb7c48919424e887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e880 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.870646:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22fa00, rc 0) 00000100:00100000:1.0:1787548629.870674:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431853312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548629.870680:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787548629.870706:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431853312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787548629.870716:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e887 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.870724:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e887 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548629.870760:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431853440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787548629.870781:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548629.870793:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd4b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787548629.870803:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431853440 00000100:00100000:1.0:1787548629.870805:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431853440 00000100:00100000:1.0:1787548629.870820:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787548629.870825:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431853440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787548629.870992:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431853440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548629.870998:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787548629.871022:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431853440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787548629.871051:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431853568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548629.871079:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548629.871091:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd4b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787548629.871101:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431853568 00000100:00100000:1.0:1787548629.871104:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431853568 00000100:00100000:1.0:1787548629.871119:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787548629.871124:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431853568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548629.871264:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431853568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548629.871270:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787548629.871315:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431853568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548629.871522:0:8526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8526:1874380431853696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548629.871553:0:8526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548629.871571:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431853696 00000100:00100000:1.0:1787548629.871574:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431853696 00000100:00100000:1.0:1787548629.871592:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787548629.871597:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:8526:x1874380431853696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548629.871714:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:8526:x1874380431853696:12345-0@lo:502:llog_process_th.0 Request processed in 115us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548629.871721:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787548629.871748:0:8526:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd4bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787548629.871760:0:8526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8526:1874380431853696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787548629.871779:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548629.871785:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548629.871791:0:8526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787548629.871796:0:8526:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fecad08a800 00000020:00000080:1.0:1787548629.871799:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787548629.871850:0:8526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8526:1874380431853824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548629.871883:0:8526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548629.871903:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431853824 00000100:00100000:1.0:1787548629.871907:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431853824 00000100:00100000:1.0:1787548629.871925:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787548629.871932:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:8526:x1874380431853824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548629.872033:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:8526:x1874380431853824:12345-0@lo:502:llog_process_th.0 Request processed in 101us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548629.872041:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787548629.876420:0:8526:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd4bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787548629.876462:0:8526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8526:1874380431853824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787548629.876513:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787548629.876521:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548629.876523:0:8526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787548629.876529:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787548629.876670:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787548629.876698:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787548629.876709:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e887 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548629.876719:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e887 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548629.876729:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787548629.876732:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fec8644c800 from 4 10000000:01000000:3.0:1787548629.876735:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787548629.876772:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548629.876781:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548629.876790:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548629.876811:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90097b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431853952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787548629.876869:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548629.876900:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787548629.876900:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431853952 00000100:00100000:2.0:1787548629.876906:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431853952 00000100:00100000:2.0:1787548629.876951:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787548629.876961:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431853952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548629.876974:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548629.876986:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecc21ec400/0xcb7c48919424e895 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e88e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.877009:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecc21ec400/0xcb7c48919424e895 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e88e expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.877019:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecc21ec400/0xcb7c48919424e895 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e88e expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.877027:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ec400, rc 0) 00000100:00100000:2.0:1787548629.877067:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431853952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548629.877073:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787548629.877113:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90097b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431853952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548629.877125:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e895 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548629.877153:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e895 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548629.877215:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431854080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548629.877255:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548629.877272:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca0a1a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787548629.877283:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431854080 00000100:00100000:2.0:1787548629.877286:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431854080 00000100:00100000:2.0:1787548629.877307:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787548629.877312:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431854080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548629.877544:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431854080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548629.877552:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787548629.877584:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431854080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548629.877609:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431854208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787548629.877648:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548629.877670:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca0a1a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787548629.877685:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431854208 00000100:00100000:2.0:1787548629.877689:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431854208 00000100:00100000:2.0:1787548629.877719:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787548629.877729:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431854208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787548629.877878:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431854208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548629.877885:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787548629.878901:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431854208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548629.879100:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd060a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8528:1874380431854336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548629.879166:0:8528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548629.879191:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431854336 00000100:00100000:1.0:1787548629.879196:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431854336 00000100:00100000:1.0:1787548629.879239:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787548629.879247:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:8528:x1874380431854336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548629.879405:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:8528:x1874380431854336:12345-0@lo:502:llog_process_th.0 Request processed in 158us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548629.879413:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787548629.879445:0:8528:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a600 going to sleep for 11 seconds 00000100:00100000:1.0:1787548629.879456:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd060a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8528:1874380431854336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787548629.879475:0:8528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548629.879487:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548629.879489:0:8528:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787548629.879496:0:8528:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fec8644c800 00000020:00000080:1.0:1787548629.879498:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787548629.879830:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd060a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8528:1874380431854464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548629.879863:0:8528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548629.879875:0:8528:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787548629.879962:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431854464 00000100:00100000:2.0:1787548629.879967:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431854464 00000100:00100000:2.0:1787548629.879996:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787548629.880009:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:8528:x1874380431854464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787548629.880155:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:8528:x1874380431854464:12345-0@lo:502:llog_process_th.0 Request processed in 146us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548629.880162:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787548629.880199:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd060a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:8528:1874380431854464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787548629.880217:0:8528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787548629.880233:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787548629.880234:0:8528:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787548629.880239:0:8528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787548629.881236:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787548629.881263:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787548629.881273:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e895 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548629.881286:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e895 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548630.468506:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548630.523581:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548630.525322:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416096000 00000100:00100000:0.0:1787548630.525341:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416096000 00000100:00100000:0.0:1787548630.525493:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 185 00000100:00100000:0.0:1787548630.525506:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+9:5595:x1874380416096000:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787548630.525600:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548630.525625:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90150e00/0xcb7c48919424e89c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2141 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548630.525661:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90150e00/0xcb7c48919424e89c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2141 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548630.525690:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90150e00/0xcb7c48919424e89c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2141 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548630.525702:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150e00, rc 0) 00000100:00100000:0.0:1787548630.525785:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5595:x1874380416096000:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 Request processed in 281us (2277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548630.525792:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 185 00000100:00100000:0.0:1787548630.530666:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548630.530741:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416096128 00000100:00100000:1.0:1787548630.530767:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416096128 00000100:00100000:1.0:1787548630.530842:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 186 00000100:00100000:1.0:1787548630.530853:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5595:x1874380416096128:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787548630.531156:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5595:x1874380416096128:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 Request processed in 303us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548630.531165:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 186 00000100:00100000:2.0:1787548630.542562:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548630.542640:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416096256 00000100:00100000:1.0:1787548630.542654:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416096256 00000100:00100000:1.0:1787548630.542726:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 187 00000100:00100000:1.0:1787548630.542740:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5595:x1874380416096256:12345-192.168.206.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548630.542994:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:5595:x1874380416096256:12345-192.168.206.13@tcp:503:ll_cfg_requeue.0 Request processed in 258us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548630.543013:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 187 00000100:00100000:0.0:1787548630.557438:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548630.557774:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416096384 00000100:00100000:3.0:1787548630.557787:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416096384 00000100:00100000:3.0:1787548630.558667:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 188 00000100:00100000:3.0:1787548630.558684:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+10:6126:x1874380416096384:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787548630.558969:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+10:6126:x1874380416096384:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 290us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548630.558978:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 188 00000100:00100000:0.0:1787548630.564706:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548630.573514:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416096512 00000100:00100000:2.0:1787548630.573535:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416096512 00000100:00100000:2.0:1787548630.573627:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 189 00000100:00100000:2.0:1787548630.573639:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:6126:x1874380416096512:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787548630.573957:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:6126:x1874380416096512:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 320us (9265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548630.573967:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 189 00010000:00010000:0.0:1787548631.494418:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548632.515355:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548632.579381:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787548632.579693:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431854592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548632.583143:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787548632.583166:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431854720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548632.583241:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548632.583702:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8829b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431855232:0@lo:400:kworker.0 00000100:00100000:0.0:1787548632.583733:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548632.583766:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787548632.583771:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8829a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431854848:0@lo:400:kworker.0 00000100:00100000:0.0:1787548632.583797:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548632.583819:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431855360:0@lo:400:kworker.0 00000100:00100000:0.0:1787548632.583846:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548632.583848:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431854720 00000100:00100000:1.0:1787548632.583856:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431854720 00000100:00100000:0.0:1787548632.583870:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431855232 00000100:00100000:0.0:1787548632.583873:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431855232 00000100:00100000:1.0:1787548632.583906:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787548632.583906:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787548632.583915:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431854720:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548632.583915:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431855232:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787548632.583949:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548632.583967:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431855232:12345-0@lo:400:kworker.0 Request processed in 53us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548632.583974:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787548632.583977:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431854720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548632.583982:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787548632.583993:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431855360 00000100:00080000:1.0:1787548632.583995:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787548632.583996:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431855360 00000100:00080000:1.0:1787548632.583998:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787548632.584028:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548632.584034:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787548632.584041:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431855360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548632.584072:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431855360:12345-0@lo:400:kworker.0 Request processed in 32us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548632.584078:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787548632.584114:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431855104:0@lo:400:kworker.0 00000100:00100000:0.0:1787548632.584170:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548632.584194:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787548632.584197:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431855104 00000100:00100000:0.0:1787548632.584199:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431854976:0@lo:400:kworker.0 00000100:00100000:1.0:1787548632.584201:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431855104 00000100:00100000:0.0:1787548632.584233:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548632.584239:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431854976 00000100:00100000:1.0:1787548632.584241:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431854976 00000100:00100000:1.0:1787548632.584255:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787548632.584260:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431855104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548632.584295:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431855104:12345-0@lo:400:kworker.0 Request processed in 34us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548632.584465:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787548632.584474:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431854976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548632.584581:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431854976:12345-0@lo:400:kworker.0 Request processed in 109us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548632.584588:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787548632.584626:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431854976:0@lo:400:kworker.0 00000100:00100000:0.0:1787548632.584636:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431855104:0@lo:400:kworker.0 00000100:00100000:0.0:1787548632.584667:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431855360:0@lo:400:kworker.0 00010000:00080000:0.0:1787548632.584679:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8829b100 x1874380431855232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548632.584698:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8829b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431855232:0@lo:400:kworker.0 00010000:00080000:0.0:1787548632.584726:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecad283480 x1874380431854720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548632.584804:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431854720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548632.584857:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548632.584867:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787548632.584887:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548632.584904:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431854848 00000100:00100000:3.0:1787548632.584908:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431854848 00000100:00100000:3.0:1787548632.584943:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787548632.584950:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec900bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431854848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548632.584988:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec900bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431854848:12345-0@lo:400:kworker.0 Request processed in 40us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548632.585001:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787548632.585047:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8829a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431854848:0@lo:400:kworker.0 00000100:00100000:0.0:1787548632.585840:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431854592 00000100:00100000:0.0:1787548632.585847:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431854592 00000100:00100000:0.0:1787548632.585886:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787548632.585894:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431854592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787548632.585922:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548632.585982:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431854592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (2490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548632.585988:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787548632.586117:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca2f3df80 x1874380431854592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548632.586160:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431854592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787548633.152339:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548633.152436:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548633.152496:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548633.152523:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548633.152549:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416096640 00000100:00100000:1.0:1787548633.152565:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416096640 00000100:00100000:1.0:1787548633.152649:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 191 00000100:00100000:1.0:1787548633.152660:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec900bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2353:x1874380416096640:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548633.152726:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec900bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2353:x1874380416096640:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 68us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548633.152746:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 191 00000100:00100000:1.0:1787548633.156243:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416096768 00000100:00100000:1.0:1787548633.156429:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416096768 00000100:00100000:1.0:1787548633.156505:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 32 00000100:00100000:1.0:1787548633.156518:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2353:x1874380416096768:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548633.156599:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2353:x1874380416096768:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 84us (4101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548633.156607:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 32 00000100:00080000:1.0:1787548633.156629:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548633.160538:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416096896 00000100:00100000:0.0:1787548633.160552:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416096896 00000100:00100000:0.0:1787548633.160647:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416097024 00000100:00100000:0.0:1787548633.160651:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416097024 00000100:00080000:2.0:1787548633.163628:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787548633.163637:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548633.165493:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 17 00000100:00100000:1.0:1787548633.165517:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416096896:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548633.165624:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416096896:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 117us (13186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548633.165632:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 17 00000100:00100000:0.0:1787548633.167873:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00100000:0.0:1787548633.167887:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416097024:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548633.167949:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416097024:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 66us (15425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548633.167956:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 18 00010000:00010000:2.0:1787548633.539353:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548634.563356:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787548635.462557:0:8811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg613-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1787548635.588450:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548636.611588:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548637.636972:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548637.699420:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431855488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548637.699536:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548637.699750:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431855488 00000100:00100000:2.0:1787548637.699758:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431855488 00000100:00100000:2.0:1787548637.699828:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787548637.699838:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431855488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787548637.699871:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548637.699934:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431855488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548637.699941:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787548637.700270:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787548637.700300:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca2f3e680 x1874380431855488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548637.700331:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431855488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548637.700671:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431855744:0@lo:400:kworker.0 00000100:00100000:3.0:1787548637.700711:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548637.700754:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787548637.700760:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431855872:0@lo:400:kworker.0 00000100:00100000:3.0:1787548637.700782:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548637.700809:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431855744 00000100:00100000:3.0:1787548637.700814:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431855744 00000100:00100000:3.0:1787548637.700843:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431855872 00000100:00100000:3.0:1787548637.700846:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431855872 00000100:00100000:3.0:1787548637.700868:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787548637.700875:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431855744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548637.700926:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431855744:12345-0@lo:400:kworker.0 Request processed in 52us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548637.700933:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787548637.700947:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787548637.700953:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431855872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548637.700981:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431855872:12345-0@lo:400:kworker.0 Request processed in 28us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548637.700987:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787548637.701015:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431855872:0@lo:400:kworker.0 00000100:00100000:3.0:1787548637.701025:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431855744:0@lo:400:kworker.0 00000100:00100000:3.0:1787548637.701043:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431856000:0@lo:400:kworker.0 00000100:00100000:3.0:1787548637.701076:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548637.701094:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787548637.701099:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431855616:0@lo:400:kworker.0 00000100:00100000:3.0:1787548637.701123:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548637.701170:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431856128:0@lo:400:kworker.0 00000100:00100000:3.0:1787548637.701205:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548637.701227:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431856000 00000100:00100000:3.0:1787548637.701230:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431856000 00000100:00100000:3.0:1787548637.701251:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787548637.701256:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431856000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548637.701288:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431856000:12345-0@lo:400:kworker.0 Request processed in 32us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548637.701294:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787548637.701317:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431856000:0@lo:400:kworker.0 00000100:00100000:1.0:1787548637.701669:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431855616 00000100:00100000:1.0:1787548637.701673:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431855616 00000100:00100000:1.0:1787548637.701709:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787548637.701717:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431855616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548637.701770:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431855616:12345-0@lo:400:kworker.0 Request processed in 54us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548637.701777:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787548637.701805:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431856128 00000100:00100000:1.0:1787548637.701809:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431856128 00000100:00100000:1.0:1787548637.701835:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787548637.701842:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431856128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548637.701872:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431856128:12345-0@lo:400:kworker.0 Request processed in 31us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548637.701878:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787548637.702038:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431855616:0@lo:400:kworker.0 00010000:00080000:2.0:1787548637.702052:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca2f3fb80 x1874380431856128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548637.702064:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431856128:0@lo:400:kworker.0 00000100:00080000:1.0:1787548637.702107:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787548637.702113:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548637.702172:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787548637.702195:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431856256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548637.702229:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548637.702327:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431856256 00000100:00100000:2.0:1787548637.702331:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431856256 00000100:00100000:2.0:1787548637.702363:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787548637.702370:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431856256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787548637.702394:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548637.702441:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431856256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548637.702447:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787548637.702515:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecbd061880 x1874380431856256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548637.702528:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431856256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548638.262427:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548638.262498:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548638.262538:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416097152 00000100:00100000:3.0:1787548638.262547:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548638.262560:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416097152 00000100:00100000:3.0:1787548638.262594:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548638.262650:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 193 00000100:00100000:3.0:1787548638.262667:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416097408 00000100:00100000:1.0:1787548638.262668:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2351:x1874380416097152:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548638.262681:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416097408 00000100:00100000:1.0:1787548638.262780:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2351:x1874380416097152:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 111us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548638.262809:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 193 00000100:00100000:0.0:1787548638.262916:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416097536 00000100:00100000:0.0:1787548638.262924:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416097536 00000100:00100000:3.0:1787548638.262984:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00100000:3.0:1787548638.263000:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416097408:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548638.263070:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416097408:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 76us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548638.263078:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00100000:3.0:1787548638.263096:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 21 00000100:00100000:3.0:1787548638.263118:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416097536:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548638.263215:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416097536:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 97us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548638.263223:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 21 00000100:00080000:3.0:1787548638.263251:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787548638.263256:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787548638.263691:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416097280 00000100:00100000:2.0:1787548638.263699:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416097280 00000100:00100000:2.0:1787548638.263765:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 36 00000100:00100000:2.0:1787548638.263775:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416097280:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548638.264022:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416097280:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 246us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548638.264040:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 36 00000100:00080000:3.0:1787548638.264211:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787548638.662271:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548639.694328:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548640.707250:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787548641.272887:0:9055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg613-server.virtnet: executing yml_node 00010000:00010000:1.0:1787548641.739002:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548642.755384:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548642.819584:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431856384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548642.819650:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548642.820674:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431856384 00000100:00100000:2.0:1787548642.820683:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431856384 00000100:00100000:2.0:1787548642.820756:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787548642.820766:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431856384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787548642.820801:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548642.823907:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431856384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3133us (4246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548642.823921:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787548642.823981:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431856512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787548642.824037:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548642.824073:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787548642.824080:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431856640:0@lo:400:kworker.0 00000100:00100000:2.0:1787548642.824106:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787548642.824165:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787548642.824181:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431856512 00000100:00100000:2.0:1787548642.824189:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431856512 00000100:00100000:2.0:1787548642.824228:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787548642.824236:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431856512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787548642.824271:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548642.824314:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431856512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548642.824321:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787548642.824338:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431856640 00000100:00100000:2.0:1787548642.824341:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431856640 00000100:00100000:2.0:1787548642.824383:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787548642.824389:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431856640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548642.824552:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431856640:12345-0@lo:400:kworker.0 Request processed in 31us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548642.824561:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:2.0:1787548642.824698:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787548642.824723:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431856640:0@lo:400:kworker.0 00010000:00080000:2.0:1787548642.825271:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca2f3fb80 x1874380431856512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548642.825293:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431856512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548642.825588:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431856768:0@lo:400:kworker.0 00000100:00100000:0.0:1787548642.825631:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548642.825781:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431857024:0@lo:400:kworker.0 00000100:00100000:1.0:1787548642.825808:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548642.825837:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431856768 00000100:00100000:1.0:1787548642.825842:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431856768 00000100:00100000:1.0:1787548642.825874:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431857024 00000100:00100000:1.0:1787548642.825877:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431857024 00000100:00100000:1.0:1787548642.825903:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787548642.825910:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431856768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548642.825945:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431856768:12345-0@lo:400:kworker.0 Request processed in 35us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548642.825951:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787548642.825964:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787548642.825969:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431857024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548642.825995:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431857024:12345-0@lo:400:kworker.0 Request processed in 26us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548642.826001:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787548642.826016:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787548642.826035:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431857024:0@lo:400:kworker.0 00000100:00100000:0.0:1787548642.826216:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431856768:0@lo:400:kworker.0 00000100:00100000:0.0:1787548642.826227:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787548642.826232:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431856896:0@lo:400:kworker.0 00000100:00100000:0.0:1787548642.826255:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548642.826629:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431856896 00000100:00100000:1.0:1787548642.826634:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431856896 00000100:00100000:1.0:1787548642.826676:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787548642.826682:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431856896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548642.826722:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431856896:12345-0@lo:400:kworker.0 Request processed in 40us (466us total) trans 0 rc 0/0 00000100:00080000:0.0:1787548642.826793:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548642.826815:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431856896:0@lo:400:kworker.0 00000100:00100000:1.0:1787548642.826862:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787548642.827698:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecbd061880 x1874380431856384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548642.827718:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431856384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548643.389254:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548643.389315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548643.389461:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416097792 00000100:00100000:3.0:1787548643.389471:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416097792 00000100:00100000:3.0:1787548643.389537:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 40 00000100:00100000:3.0:1787548643.389547:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416097792:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548643.389617:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416097792:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 72us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548643.389625:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 40 00000100:00080000:0.0:1787548643.390001:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548643.390282:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416097664 00000100:00100000:2.0:1787548643.390288:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416097664 00000100:00100000:2.0:1787548643.390334:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 195 00000100:00100000:2.0:1787548643.390342:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2351:x1874380416097664:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548643.390384:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2351:x1874380416097664:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 43us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548643.390392:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 195 00000100:00100000:1.0:1787548643.395923:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548643.395963:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548643.396034:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416097920 00000100:00100000:0.0:1787548643.396044:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416097920 00000100:00100000:0.0:1787548643.396116:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416098048 00000100:00100000:0.0:1787548643.396119:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416098048 00000100:00100000:0.0:1787548643.396173:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:0.0:1787548643.396183:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2350:x1874380416097920:12345-192.168.206.13@tcp:9:kworker.0 00000020:00000080:0.0:1787548643.396215:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e7d8 00000100:00080000:0.0:1787548643.396223:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8fecbcb47000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787548643.396259:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787548643.396587:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+2:2350:x1874380416097920:12345-192.168.206.13@tcp:9:kworker.0 Request processed in 405us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548643.396596:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:0.0:1787548643.396611:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:0.0:1787548643.396631:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2350:x1874380416098048:12345-192.168.206.13@tcp:9:kworker.0 00000020:00000080:0.0:1787548643.396644:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e7df 00000100:00080000:0.0:1787548643.396650:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8fecbcb43800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787548643.396671:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787548643.396839:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+2:2350:x1874380416098048:12345-192.168.206.13@tcp:9:kworker.0 Request processed in 208us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548643.396846:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 11 00010000:00010000:0.0:1787548643.396863:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548643.397407:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787548643.397507:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787548643.397512:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787548643.779851:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787548643.935226:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000020:00000080:2.0:1787548643.935235:0:6716:0:(genops.c:885:class_export_put()) final put ffff8fecbcb44000/e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000020:00000080:2.0:1787548643.935261:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecbcb44000/e4505aba-b49a-4ae4-be2d-9f5ba513779c for lustre-OST0000 00000020:00000080:2.0:1787548643.935319:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fecbcb47000 for lustre-OST0000 00010000:00010000:1.0:1787548644.807369:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787548645.554642:0:9248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.82 00010000:00010000:0.0:1787548645.827711:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548646.856198:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787548646.964979:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000020:00000080:2.0:1787548646.964988:0:7647:0:(genops.c:885:class_export_put()) final put ffff8fecbcb42800/e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000020:00000080:0.0:1787548646.965084:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecbcb42800/e4505aba-b49a-4ae4-be2d-9f5ba513779c for lustre-OST0001 00000020:00000080:0.0:1787548646.965382:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fecbcb43800 for lustre-OST0001 00010000:00010000:1.0:1787548647.877364:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548647.939641:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431857536:0@lo:400:kworker.0 00000100:00100000:1.0:1787548647.939740:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548647.939811:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787548647.939819:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431857152:0@lo:400:kworker.0 00000100:00100000:1.0:1787548647.939852:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548647.939873:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431857664:0@lo:400:kworker.0 00000100:00100000:1.0:1787548647.939900:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548647.939928:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431857280:0@lo:400:kworker.0 00000100:00100000:1.0:1787548647.939953:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548647.939969:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431857792:0@lo:400:kworker.0 00000100:00100000:1.0:1787548647.939990:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548647.940007:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787548647.940013:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431857408:0@lo:400:kworker.0 00000100:00100000:1.0:1787548647.940037:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548647.940069:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431857536 00000100:00100000:1.0:1787548647.940078:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431857536 00000100:00100000:1.0:1787548647.940195:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431857792 00000100:00100000:1.0:1787548647.940200:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431857792 00000100:00100000:1.0:1787548647.940221:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787548647.940230:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431857536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548647.940291:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431857536:12345-0@lo:400:kworker.0 Request processed in 61us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548647.940299:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787548647.940317:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787548647.940323:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431857792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548647.940356:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431857792:12345-0@lo:400:kworker.0 Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548647.940362:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787548647.940381:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431857664 00000100:00100000:1.0:1787548647.940385:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431857664 00000100:00100000:1.0:1787548647.940413:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431857280 00000100:00100000:1.0:1787548647.940416:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431857280 00000100:00100000:1.0:1787548647.940426:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431857408 00000100:00100000:1.0:1787548647.940429:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431857408 00000100:00100000:1.0:1787548647.940442:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787548647.940448:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431857664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548647.940479:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431857664:12345-0@lo:400:kworker.0 Request processed in 31us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548647.940486:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787548647.940496:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787548647.940502:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431857280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548647.940526:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431857280:12345-0@lo:400:kworker.0 Request processed in 24us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548647.940542:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787548647.940553:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787548647.940558:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431857408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548647.940583:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431857408:12345-0@lo:400:kworker.0 Request processed in 25us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548647.940589:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1787548647.940605:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787548647.940610:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787548647.940612:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548647.940645:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431857408:0@lo:400:kworker.0 00000100:00100000:1.0:1787548647.940655:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431857280:0@lo:400:kworker.0 00010000:00080000:1.0:1787548647.940667:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecbd062300 x1874380431857792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548647.940677:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431857792:0@lo:400:kworker.0 00000100:00100000:1.0:1787548647.940706:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431857664:0@lo:400:kworker.0 00010000:00080000:1.0:1787548647.940716:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecbd061f80 x1874380431857536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548647.940724:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431857536:0@lo:400:kworker.0 00000100:00100000:2.0:1787548647.940858:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431857152 00000100:00100000:2.0:1787548647.940863:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431857152 00000100:00100000:2.0:1787548647.940896:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787548647.940903:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431857152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548647.940947:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431857152:12345-0@lo:400:kworker.0 Request processed in 45us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548647.940953:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787548647.941002:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431857152:0@lo:400:kworker.0 00000100:00100000:2.0:1787548647.941368:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787548647.941380:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec87e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431857920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787548647.941416:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548647.941494:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431857920 00000100:00100000:0.0:1787548647.941500:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431857920 00000100:00100000:0.0:1787548647.941538:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787548647.941547:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431857920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787548647.941582:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548647.941629:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431857920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548647.941635:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787548647.941737:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec87e91c00 x1874380431857920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548647.941755:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec87e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431857920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548647.944185:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787548647.944221:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431858048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548647.944317:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548647.944843:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431858048 00000100:00100000:1.0:1787548647.944855:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431858048 00000100:00100000:1.0:1787548647.944923:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787548647.944934:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431858048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787548647.944981:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548647.945081:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431858048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548647.945090:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787548647.945268:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecbd061880 x1874380431858048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548647.945307:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431858048:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787548648.242298:0:9346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.82 00000100:00100000:1.0:1787548648.516790:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548648.516892:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548648.517232:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416098304 00000100:00100000:2.0:1787548648.517242:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416098304 00000100:00100000:2.0:1787548648.517347:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 44 00000100:00100000:2.0:1787548648.517358:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2353:x1874380416098304:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548648.517429:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2353:x1874380416098304:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 73us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548648.517436:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 44 00000100:00080000:1.0:1787548648.517736:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548648.518019:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416098176 00000100:00100000:0.0:1787548648.518025:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416098176 00000100:00100000:0.0:1787548648.518461:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 197 00000100:00100000:0.0:1787548648.518471:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2353:x1874380416098176:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548648.518536:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2353:x1874380416098176:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 67us (1755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548648.518543:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 197 00010000:00010000:3.0:1787548648.899428:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548649.924084:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787548650.710631:0:9444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.82 00010000:00010000:2.0:1787548650.947381:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548651.972699:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787548652.418810:0:9493:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 01:17:31 EDT 2026 00010000:00010000:3.0:1787548652.996560:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548653.059631:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431858560:0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.059700:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548653.059761:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787548653.059768:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431858176:0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.059796:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548653.059819:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431858688:0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.059845:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548653.059871:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431858304:0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.059894:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548653.059912:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431858816:0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.059940:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548653.060010:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787548653.060017:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431858432:0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.060062:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548653.060298:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431858176 00000100:00100000:2.0:1787548653.060306:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431858176 00000100:00100000:2.0:1787548653.060351:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787548653.060360:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431858176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.060411:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431858176:12345-0@lo:400:kworker.0 Request processed in 52us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548653.060420:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787548653.060461:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431858688 00000100:00100000:2.0:1787548653.060466:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431858688 00000100:00100000:2.0:1787548653.060504:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431858304 00000100:00100000:2.0:1787548653.060508:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431858304 00000100:00100000:2.0:1787548653.060521:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431858432 00000100:00100000:2.0:1787548653.060531:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431858432 00000100:00100000:2.0:1787548653.060556:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787548653.060562:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431858688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.060603:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431858688:12345-0@lo:400:kworker.0 Request processed in 39us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548653.060610:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787548653.060626:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787548653.060634:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431858304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.060668:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431858304:12345-0@lo:400:kworker.0 Request processed in 35us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548653.060674:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787548653.060687:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787548653.060693:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431858432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.060721:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431858432:12345-0@lo:400:kworker.0 Request processed in 28us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548653.060727:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787548653.060748:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431858560 00000100:00100000:2.0:1787548653.060752:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431858560 00000100:00100000:2.0:1787548653.060775:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431858816 00000100:00100000:2.0:1787548653.060778:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431858816 00000100:00100000:2.0:1787548653.060793:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787548653.060799:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431858560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.060828:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431858560:12345-0@lo:400:kworker.0 Request processed in 29us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548653.060834:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787548653.060845:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787548653.060851:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431858816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.060890:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431858816:12345-0@lo:400:kworker.0 Request processed in 38us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548653.060897:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787548653.060943:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431858432:0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.060955:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431858304:0@lo:400:kworker.0 00010000:00080000:2.0:1787548653.060966:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca2f3e680 x1874380431858816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548653.060976:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431858816:0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.061007:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431858176:0@lo:400:kworker.0 00000100:00100000:2.0:1787548653.061016:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431858688:0@lo:400:kworker.0 00010000:00080000:2.0:1787548653.061026:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca2f3ce00 x1874380431858560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548653.061035:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431858560:0@lo:400:kworker.0 00000100:00080000:1.0:1787548653.062269:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787548653.062276:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787548653.062279:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548653.062321:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431858944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548653.062411:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548653.062470:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787548653.062487:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431859072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548653.063601:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431858944 00000100:00100000:1.0:1787548653.063613:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431858944 00000100:00100000:1.0:1787548653.063678:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787548653.063690:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431858944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787548653.063724:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548653.063797:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431858944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548653.063803:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787548653.064313:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548653.064419:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431859072 00000100:00100000:1.0:1787548653.064424:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431859072 00000100:00100000:1.0:1787548653.064461:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787548653.064468:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431859072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787548653.064490:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548653.064530:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431859072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548653.064536:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787548653.064609:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecbd060a80 x1874380431858944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548653.064638:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431858944:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787548653.064699:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8833ea00 x1874380431859072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548653.064724:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431859072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548653.625456:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548653.625504:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548653.625569:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416098432 00000100:00100000:2.0:1787548653.625579:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416098432 00000100:00100000:2.0:1787548653.625624:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 199 00000100:00100000:2.0:1787548653.625641:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2353:x1874380416098432:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548653.625713:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2353:x1874380416098432:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 73us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548653.625720:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 199 00000100:00100000:3.0:1787548653.625910:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416098560 00000100:00100000:3.0:1787548653.625914:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416098560 00000100:00100000:3.0:1787548653.625970:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 48 00000100:00100000:3.0:1787548653.625978:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2353:x1874380416098560:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548653.626011:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2353:x1874380416098560:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 35us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548653.626018:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 48 00000100:00080000:1.0:1787548653.626785:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787548654.026617:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548655.045787:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548656.068498:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548657.091477:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548658.121447:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548658.179389:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431859200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548658.179461:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548658.179756:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431859200 00000100:00100000:2.0:1787548658.179765:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431859200 00000100:00100000:2.0:1787548658.179827:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787548658.179837:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431859200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787548658.179868:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548658.179912:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431859200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548658.179919:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787548658.180000:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8833ea00 x1874380431859200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548658.180018:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431859200:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787548658.180324:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787548658.180744:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431859456:0@lo:400:kworker.0 00000100:00100000:0.0:1787548658.180783:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548658.180817:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431859968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548658.180838:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548658.180863:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787548658.180869:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431859328:0@lo:400:kworker.0 00000100:00100000:0.0:1787548658.180893:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548658.180913:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431859840:0@lo:400:kworker.0 00000100:00100000:0.0:1787548658.180935:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548658.180961:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431859328 00000100:00100000:0.0:1787548658.180966:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431859328 00000100:00100000:0.0:1787548658.180998:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787548658.181005:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3316:x1874380431859328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548658.181041:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3316:x1874380431859328:12345-0@lo:400:kworker.0 Request processed in 37us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548658.181048:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787548658.181076:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431859840 00000100:00100000:0.0:1787548658.181089:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431859840 00000100:00100000:0.0:1787548658.181146:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787548658.181154:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431859840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548658.181185:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431859840:12345-0@lo:400:kworker.0 Request processed in 33us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548658.181191:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787548658.181209:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787548658.181216:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431859968 00000100:00100000:0.0:1787548658.181219:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431859968 00000100:00100000:0.0:1787548658.181239:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787548658.181244:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431859968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787548658.181265:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548658.181293:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431859968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548658.181298:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787548658.181325:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431859328:0@lo:400:kworker.0 00010000:00080000:0.0:1787548658.181336:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecad098380 x1874380431859840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548658.181346:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431859840:0@lo:400:kworker.0 00010000:00080000:0.0:1787548658.181355:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecbd061180 x1874380431859968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548658.181365:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431859968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548658.181443:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431859456 00000100:00100000:1.0:1787548658.181447:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431859456 00000100:00100000:1.0:1787548658.181482:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787548658.181488:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431859456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548658.181537:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431859456:12345-0@lo:400:kworker.0 Request processed in 49us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548658.181543:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787548658.181832:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431859584:0@lo:400:kworker.0 00000100:00100000:3.0:1787548658.181863:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548658.181884:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787548658.181891:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431859712:0@lo:400:kworker.0 00000100:00100000:3.0:1787548658.181911:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548658.181934:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431859584 00000100:00100000:3.0:1787548658.181938:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431859584 00000100:00100000:3.0:1787548658.181966:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431859712 00000100:00100000:3.0:1787548658.181976:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431859712 00000100:00100000:3.0:1787548658.181994:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787548658.181999:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431859584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548658.182033:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431859584:12345-0@lo:400:kworker.0 Request processed in 34us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548658.182040:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787548658.182053:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787548658.182059:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431859712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548658.182094:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431859712:12345-0@lo:400:kworker.0 Request processed in 36us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548658.182099:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787548658.182113:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548658.182149:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431859712:0@lo:400:kworker.0 00000100:00100000:3.0:1787548658.182159:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431859584:0@lo:400:kworker.0 00000100:00100000:0.0:1787548658.182330:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431859456:0@lo:400:kworker.0 00000100:00100000:1.0:1787548658.742791:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548658.742848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548658.743068:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416098816 00000100:00100000:3.0:1787548658.743087:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416098816 00000100:00080000:1.0:1787548658.743217:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548658.743353:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 52 00000100:00100000:3.0:1787548658.743365:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416098816:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548658.743441:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416098816:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 79us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548658.743449:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 52 00000100:00100000:0.0:1787548658.743519:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416098688 00000100:00100000:0.0:1787548658.743524:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416098688 00000100:00100000:0.0:1787548658.743564:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 201 00000100:00100000:0.0:1787548658.743579:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2352:x1874380416098688:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548658.743608:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2352:x1874380416098688:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 31us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548658.743614:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 201 00010000:00010000:0.0:1787548659.139615:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548660.163615:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548661.187272:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548662.212396:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548663.240690:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548663.299449:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec87e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431860096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548663.299514:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548663.299583:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787548663.299590:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431860224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548663.299614:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548663.299771:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431860352:0@lo:400:kworker.0 00000100:00100000:2.0:1787548663.299814:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548663.299834:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431860864:0@lo:400:kworker.0 00000100:00100000:2.0:1787548663.299862:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548663.299883:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787548663.299889:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431860480:0@lo:400:kworker.0 00000100:00100000:2.0:1787548663.299910:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548663.299938:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431860864 00000100:00100000:2.0:1787548663.299947:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431860864 00000100:00100000:2.0:1787548663.300002:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431860480 00000100:00100000:2.0:1787548663.300006:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431860480 00000100:00100000:2.0:1787548663.300028:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787548663.300046:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431860864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548663.300112:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431860864:12345-0@lo:400:kworker.0 Request processed in 67us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548663.300119:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787548663.300166:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787548663.300174:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431860480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548663.300203:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431860480:12345-0@lo:400:kworker.0 Request processed in 30us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548663.300208:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1787548663.300224:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548663.300254:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431860480:0@lo:400:kworker.0 00000100:00100000:2.0:1787548663.300265:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431860864:0@lo:400:kworker.0 00000100:00100000:3.0:1787548663.300895:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431860608:0@lo:400:kworker.0 00000100:00100000:3.0:1787548663.300926:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548663.300945:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787548663.300950:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431860736:0@lo:400:kworker.0 00000100:00100000:3.0:1787548663.300972:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548663.301006:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431860096 00000100:00100000:3.0:1787548663.301011:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431860096 00000100:00100000:3.0:1787548663.301043:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431860224 00000100:00100000:3.0:1787548663.301046:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431860224 00000100:00100000:3.0:1787548663.301075:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787548663.301083:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431860096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787548663.301110:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548663.301167:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431860096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548663.301174:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787548663.301186:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787548663.301192:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431860224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787548663.301209:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548663.301233:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431860224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548663.301238:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787548663.301253:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431860608 00000100:00100000:3.0:1787548663.301257:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431860608 00000100:00100000:3.0:1787548663.301282:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787548663.301297:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431860608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548663.301324:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431860608:12345-0@lo:400:kworker.0 Request processed in 29us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548663.301329:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787548663.301346:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431860736 00000100:00100000:3.0:1787548663.301349:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431860736 00000100:00100000:3.0:1787548663.301370:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787548663.301376:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431860736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548663.301401:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431860736:12345-0@lo:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548663.301407:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787548663.301424:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787548663.301428:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787548663.301430:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787548663.301451:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8833c000 x1874380431860736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548663.301463:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431860736:0@lo:400:kworker.0 00000100:00100000:3.0:1787548663.301473:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431860608:0@lo:400:kworker.0 00010000:00080000:3.0:1787548663.301481:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8833e300 x1874380431860224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548663.301492:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431860224:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787548663.301502:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec87e93800 x1874380431860096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548663.301511:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec87e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431860096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548663.301655:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431860352 00000100:00100000:0.0:1787548663.301660:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431860352 00000100:00100000:0.0:1787548663.301685:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787548663.301691:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431860352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548663.301730:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431860352:12345-0@lo:400:kworker.0 Request processed in 39us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548663.301736:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787548663.301796:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431860352:0@lo:400:kworker.0 00000100:00100000:1.0:1787548663.871358:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548663.871421:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548663.871713:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416098944 00000100:00100000:2.0:1787548663.871723:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416098944 00000100:00100000:2.0:1787548663.871781:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 203 00000100:00100000:2.0:1787548663.871791:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2353:x1874380416098944:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548663.871858:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2353:x1874380416098944:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 69us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548663.871866:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 203 00000100:00100000:3.0:1787548663.877529:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416099072 00000100:00100000:3.0:1787548663.877560:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416099072 00000100:00100000:3.0:1787548663.877717:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 56 00000100:00100000:3.0:1787548663.877726:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2354:x1874380416099072:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548663.877820:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2354:x1874380416099072:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 95us (6398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548663.877829:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 56 00000100:00080000:2.0:1787548663.878151:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787548664.259461:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548665.285237:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787548666.038056:0:10125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:17:45 (1787548665) === 00010000:00010000:1.0:1787548666.307929:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548666.730863:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548666.731053:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416099200 00000100:00100000:3.0:1787548666.731062:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416099200 00000100:00100000:3.0:1787548666.731118:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 204 00000100:00100000:3.0:1787548666.731163:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:8128:x1874380416099200:12345-192.168.206.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787548666.731179:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548666.731206:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec80030000/0xcb7c48919424e8a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2148 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548666.731235:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec80030000/0xcb7c48919424e8a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2148 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548666.731246:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec80030000/0xcb7c48919424e8a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2148 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548666.731256:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec80030000, rc 0) 00000100:00100000:3.0:1787548666.731313:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+11:8128:x1874380416099200:12345-192.168.206.13@tcp:101:mount.lustre.0 Request processed in 187us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548666.731320:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 204 00000100:00100000:1.0:1787548666.745245:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548666.748777:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416099328 00000100:00100000:2.0:1787548666.748793:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416099328 00000100:00100000:2.0:1787548666.749171:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 205 00000100:00100000:2.0:1787548666.749183:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+11:8128:x1874380416099328:12345-192.168.206.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787548666.749646:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+11:8128:x1874380416099328:12345-192.168.206.13@tcp:501:mount.lustre.0 Request processed in 455us (4398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548666.749656:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 205 00000100:00100000:1.0:1787548666.752057:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548666.752292:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416099456 00000100:00100000:2.0:1787548666.752302:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416099456 00000100:00100000:2.0:1787548666.752355:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 206 00000100:00100000:2.0:1787548666.752364:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+11:8128:x1874380416099456:12345-192.168.206.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787548666.754057:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+11:8128:x1874380416099456:12345-192.168.206.13@tcp:503:mount.lustre.0 Request processed in 1675us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548666.754069:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 206 00000100:00100000:1.0:1787548666.764438:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548666.765425:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416099584 00000100:00100000:3.0:1787548666.765435:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416099584 00000100:00100000:3.0:1787548666.765492:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 207 00000100:00100000:3.0:1787548666.765525:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+11:8132:x1874380416099584:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787548666.765899:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+11:8132:x1874380416099584:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 376us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548666.765915:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 207 00000100:00100000:1.0:1787548666.789425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548666.789523:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416099712 00000100:00100000:2.0:1787548666.789532:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416099712 00000100:00100000:2.0:1787548666.789584:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 208 00000100:00100000:2.0:1787548666.789594:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+11:8132:x1874380416099712:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787548666.789873:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+11:8132:x1874380416099712:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 279us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548666.789881:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 208 00000100:00100000:1.0:1787548666.798231:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548666.798311:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416099840 00000100:00100000:0.0:1787548666.798320:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416099840 00000100:00100000:0.0:1787548666.798371:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 209 00000100:00100000:0.0:1787548666.798380:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+11:8128:x1874380416099840:12345-192.168.206.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787548666.798396:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548666.798412:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90151c00/0xcb7c48919424e8aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2172 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548666.798438:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90151c00/0xcb7c48919424e8aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2172 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548666.798448:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90151c00/0xcb7c48919424e8aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2172 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548666.798470:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151c00, rc 0) 00000100:00100000:0.0:1787548666.798520:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+12:8128:x1874380416099840:12345-192.168.206.13@tcp:101:mount.lustre.0 Request processed in 141us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548666.798528:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 209 00000100:00100000:1.0:1787548666.810367:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548666.810555:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416099968 00000100:00100000:3.0:1787548666.810565:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416099968 00000100:00100000:3.0:1787548666.810618:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 210 00000100:00100000:3.0:1787548666.810628:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+12:8128:x1874380416099968:12345-192.168.206.13@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787548666.810651:0:5848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787548666.810672:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787548666.810676:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787548666.810679:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787548666.810682:0:5848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787548666.819563:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+12:8128:x1874380416099968:12345-192.168.206.13@tcp:256:mount.lustre.0 Request processed in 8926us (9194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548666.819577:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 210 00000100:00100000:1.0:1787548666.826267:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548666.826331:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416100096 00000100:00100000:2.0:1787548666.826341:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416100096 00000100:00100000:2.0:1787548666.826439:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 211 00000100:00100000:2.0:1787548666.826449:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+12:8128:x1874380416100096:12345-192.168.206.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787548666.826464:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548666.826481:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e8b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2179 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548666.826527:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e8b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2179 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548666.826537:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e8b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2179 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548666.826547:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ed200, rc 0) 00000100:00100000:2.0:1787548666.826602:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:8128:x1874380416100096:12345-192.168.206.13@tcp:101:mount.lustre.0 Request processed in 154us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548666.826608:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 211 00000100:00100000:1.0:1787548666.829078:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548666.829153:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416100224 00000100:00100000:3.0:1787548666.829161:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416100224 00000100:00100000:3.0:1787548666.829215:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 212 00000100:00100000:3.0:1787548666.829225:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:8128:x1874380416100224:12345-192.168.206.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787548666.829479:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:8128:x1874380416100224:12345-192.168.206.13@tcp:501:mount.lustre.0 Request processed in 254us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548666.829487:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 212 00000100:00100000:1.0:1787548666.831175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548666.831321:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416100352 00000100:00100000:2.0:1787548666.831328:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416100352 00000100:00100000:2.0:1787548666.831372:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 213 00000100:00100000:2.0:1787548666.831381:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:8128:x1874380416100352:12345-192.168.206.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787548666.831572:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:8128:x1874380416100352:12345-192.168.206.13@tcp:503:mount.lustre.0 Request processed in 191us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548666.831580:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 213 00000100:00100000:1.0:1787548666.837541:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548666.837637:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416100480 00000100:00100000:0.0:1787548666.837646:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416100480 00000100:00100000:0.0:1787548666.838097:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 214 00000100:00100000:0.0:1787548666.838108:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:8136:x1874380416100480:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787548666.838380:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:8136:x1874380416100480:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 273us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548666.838388:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 214 00000100:00100000:1.0:1787548666.840865:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548666.844708:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416100608 00000100:00100000:2.0:1787548666.844722:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416100608 00000100:00100000:2.0:1787548666.845456:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 215 00000100:00100000:2.0:1787548666.845471:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:8136:x1874380416100608:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787548666.845722:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:8136:x1874380416100608:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 254us (4862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548666.845731:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 215 00000100:00100000:1.0:1787548666.858951:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548666.859000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548666.859160:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416101120 00000100:00100000:0.0:1787548666.859170:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416101120 00000100:00100000:0.0:1787548666.859232:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416100736 00000100:00100000:0.0:1787548666.859235:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416100736 00000100:00100000:0.0:1787548666.859256:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 57 00000100:00100000:0.0:1787548666.859265:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416101120:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548666.859331:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416101120:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 67us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548666.859337:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 57 00000100:00100000:0.0:1787548666.859352:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:0.0:1787548666.859357:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1874380416100736:12345-192.168.206.13@tcp:38:mount.lustre.0 00000100:00080000:2.0:1787548666.859365:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787548666.859379:0:5856:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 92088e20-066b-499e-ac52-ab10992c506a@192.168.206.13@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:2.0:1787548666.859442:0:5856:0:(genops.c:1385:class_connect()) connect: client 92088e20-066b-499e-ac52-ab10992c506a, cookie 0xcb7c48919424e8b8 00000004:00100000:2.0:1787548666.859473:0:5856:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787548666.859773:0:5856:0:(import.c:65:import_set_state_nolock()) ffff8feb81f22800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787548666.859806:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+6:2350:x1874380416100736:12345-192.168.206.13@tcp:38:mount.lustre.0 Request processed in 446us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548666.859814:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:1.0:1787548666.868593:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548666.868642:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548666.868779:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416100864 00000100:00100000:3.0:1787548666.868788:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416100864 00000100:00100000:3.0:1787548666.868858:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416100992 00000100:00100000:3.0:1787548666.868875:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416100992 00000100:00100000:3.0:1787548666.868899:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:3.0:1787548666.868908:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+7:0:x1874380416100864:12345-192.168.206.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787548666.868956:0:5855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787548666.869033:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+7:0:x1874380416100864:12345-192.168.206.13@tcp:41:mount.lustre.0 Request processed in 126us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548666.869051:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:3.0:1787548666.869069:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:3.0:1787548666.869075:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+6:8128:x1874380416100992:12345-192.168.206.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787548666.869085:0:5855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787548666.869108:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+6:8128:x1874380416100992:12345-192.168.206.13@tcp:41:mount.lustre.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548666.869114:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00080000:0.0:1787548666.869275:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787548666.871672:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548666.872080:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416101248 00000100:00100000:3.0:1787548666.872089:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416101248 00000100:00100000:3.0:1787548666.872172:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 13 00000100:00100000:3.0:1787548666.872184:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+6:8128:x1874380416101248:12345-192.168.206.13@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787548666.872282:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+6:8128:x1874380416101248:12345-192.168.206.13@tcp:40:mount.lustre.0 Request processed in 101us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548666.872290:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 13 00000100:00100000:1.0:1787548666.874776:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548666.874859:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416101632 00000100:00100000:2.0:1787548666.874868:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416101632 00000100:00100000:2.0:1787548666.874919:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 1 00000100:00100000:2.0:1787548666.874929:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92088e20-066b-499e-ac52-ab10992c506a+6:8128:x1874380416101632:12345-192.168.206.13@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787548666.875277:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787548666.875425:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92088e20-066b-499e-ac52-ab10992c506a+6:8128:x1874380416101632:12345-192.168.206.13@tcp:33:mount.lustre.0 Request processed in 496us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548666.875433:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 1 00000100:00100000:2.0:1787548666.877638:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548666.877680:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548666.877767:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416101376 00000100:00100000:0.0:1787548666.877776:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416101376 00000100:00100000:0.0:1787548666.877816:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416101504 00000100:00100000:0.0:1787548666.877819:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416101504 00000100:00100000:0.0:1787548666.877832:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:0.0:1787548666.877839:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1874380416101376:12345-192.168.206.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787548666.877866:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 92088e20-066b-499e-ac52-ab10992c506a@192.168.206.13@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:0.0:1787548666.877896:0:6692:0:(genops.c:1385:class_connect()) connect: client 92088e20-066b-499e-ac52-ab10992c506a, cookie 0xcb7c48919424e8bf 00002000:00100000:0.0:1787548666.877907:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 92088e20-066b-499e-ac52-ab10992c506a/ffff8fecbd0b5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787548666.877929:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787548666.878687:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787548666.878720:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8fecbd0b0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787548666.878793:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92088e20-066b-499e-ac52-ab10992c506a+6:2350:x1874380416101376:12345-192.168.206.13@tcp:8:mount.lustre.0 Request processed in 952us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548666.878802:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:0.0:1787548666.878826:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 13 00000100:00100000:0.0:1787548666.878832:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1874380416101504:12345-192.168.206.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787548666.878850:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 92088e20-066b-499e-ac52-ab10992c506a@192.168.206.13@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:0.0:1787548666.878872:0:6692:0:(genops.c:1385:class_connect()) connect: client 92088e20-066b-499e-ac52-ab10992c506a, cookie 0xcb7c48919424e8c6 00002000:00100000:0.0:1787548666.878878:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 92088e20-066b-499e-ac52-ab10992c506a/ffff8fecbd0b2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787548666.878892:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787548666.879115:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787548666.879159:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8fecbd0b0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787548666.879186:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92088e20-066b-499e-ac52-ab10992c506a+6:2350:x1874380416101504:12345-192.168.206.13@tcp:8:mount.lustre.0 Request processed in 351us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548666.879323:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 13 00010000:00010000:3.0:1787548667.331381:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787548667.432079:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 92088e20-066b-499e-ac52-ab10992c506a 00000001:00100000:3.0:1787548667.938540:0:5878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 92088e20-066b-499e-ac52-ab10992c506a 00010000:00010000:1.0:1787548668.357379:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548668.420390:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431861120:0@lo:400:kworker.0 00000100:00100000:1.0:1787548668.420459:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548668.420502:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431861632:0@lo:400:kworker.0 00000100:00100000:1.0:1787548668.420528:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548668.420554:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787548668.420559:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431861248:0@lo:400:kworker.0 00000100:00100000:1.0:1787548668.420581:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548668.420611:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431861120 00000100:00100000:1.0:1787548668.420618:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431861120 00000100:00100000:1.0:1787548668.420655:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431861248 00000100:00100000:1.0:1787548668.420658:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431861248 00000100:00100000:1.0:1787548668.420683:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787548668.420692:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431861120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548668.420740:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431861120:12345-0@lo:400:kworker.0 Request processed in 49us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548668.420748:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787548668.420763:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787548668.420768:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431861248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548668.420797:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431861248:12345-0@lo:400:kworker.0 Request processed in 28us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548668.420803:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787548668.420857:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431861248:0@lo:400:kworker.0 00000100:00100000:1.0:1787548668.420868:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431861120:0@lo:400:kworker.0 00000100:00100000:2.0:1787548668.420929:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431861376:0@lo:400:kworker.0 00000100:00100000:2.0:1787548668.420960:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548668.420989:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787548668.420995:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431860992:0@lo:400:kworker.0 00000100:00100000:2.0:1787548668.421023:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548668.421058:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431861504:0@lo:400:kworker.0 00000100:00100000:2.0:1787548668.421097:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548668.421124:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431860992 00000100:00100000:2.0:1787548668.421170:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431860992 00000100:00100000:2.0:1787548668.421201:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787548668.421208:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431860992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548668.421251:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431860992:12345-0@lo:400:kworker.0 Request processed in 43us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548668.421257:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787548668.421312:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431860992:0@lo:400:kworker.0 00000100:00100000:0.0:1787548668.421390:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431861632 00000100:00100000:0.0:1787548668.421394:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431861632 00000100:00100000:0.0:1787548668.421432:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431861376 00000100:00100000:0.0:1787548668.421435:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431861376 00000100:00100000:0.0:1787548668.421453:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787548668.421459:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431861632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548668.421498:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431861632:12345-0@lo:400:kworker.0 Request processed in 39us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548668.421504:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787548668.421516:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787548668.421522:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431861376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548668.421555:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431861376:12345-0@lo:400:kworker.0 Request processed in 33us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548668.421560:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787548668.421575:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787548668.421579:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787548668.421581:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787548668.421598:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec90bd1500 x1874380431861376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548668.421609:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431861376:0@lo:400:kworker.0 00010000:00080000:0.0:1787548668.421633:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feb81a84700 x1874380431861632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548668.421641:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431861632:0@lo:400:kworker.0 00000100:00100000:1.0:1787548668.421721:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431861504 00000100:00100000:1.0:1787548668.421725:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431861504 00000100:00100000:1.0:1787548668.421764:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787548668.421770:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431861504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548668.421804:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431861504:12345-0@lo:400:kworker.0 Request processed in 34us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548668.421810:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1787548668.421952:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548668.421973:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431861504:0@lo:400:kworker.0 00000100:00100000:3.0:1787548668.424288:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431861760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548668.424358:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548668.424444:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431861760 00000100:00100000:1.0:1787548668.424451:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431861760 00000100:00100000:1.0:1787548668.424499:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787548668.424509:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431861760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787548668.424543:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548668.424591:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431861760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548668.424598:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787548668.424633:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8833dc00 x1874380431861760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548668.424652:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431861760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548668.430304:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787548668.430325:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec87e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431861888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548668.430388:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548668.430433:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431861888 00000100:00100000:0.0:1787548668.430440:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431861888 00000100:00100000:0.0:1787548668.430481:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787548668.430490:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431861888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787548668.430523:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548668.430565:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431861888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548668.430571:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787548668.430606:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec87e92a00 x1874380431861888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548668.430623:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec87e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431861888:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787548669.380001:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787548669.523878:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 92088e20-066b-499e-ac52-ab10992c506a 00010000:00010000:1.0:1787548670.403537:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548671.427936:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548672.057701:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548672.057929:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416101760 00000100:00100000:3.0:1787548672.057942:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416101760 00000100:00100000:3.0:1787548672.058006:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 217 00000100:00100000:3.0:1787548672.058027:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2351:x1874380416101760:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548672.058109:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2351:x1874380416101760:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 94us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548672.058116:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 217 00000100:00100000:0.0:1787548672.058679:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548672.059165:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548672.059191:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548672.059214:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548672.059244:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416102016 00000100:00100000:0.0:1787548672.059251:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416102016 00000100:00100000:0.0:1787548672.059302:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416101888 00000100:00100000:0.0:1787548672.059305:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416101888 00000100:00100000:0.0:1787548672.059337:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 61 00000100:00100000:0.0:1787548672.059349:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+5:2351:x1874380416102016:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548672.059435:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+5:2351:x1874380416102016:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 88us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548672.059452:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 61 00000100:00100000:0.0:1787548672.059472:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 62 00000100:00100000:0.0:1787548672.059480:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416101888:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548672.060764:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416101888:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 1281us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548672.060777:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 62 00000100:00100000:0.0:1787548672.060830:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416102272 00000100:00100000:0.0:1787548672.060839:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416102272 00000100:00100000:0.0:1787548672.060961:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416102144 00000100:00100000:0.0:1787548672.060966:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416102144 00000100:00100000:0.0:1787548672.060989:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 30 00000100:00100000:0.0:1787548672.060997:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2351:x1874380416102272:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548672.061046:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787548672.061063:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787548672.061066:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2351:x1874380416102272:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 55us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548672.061077:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 30 00000100:00100000:0.0:1787548672.061097:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 31 00000100:00100000:0.0:1787548672.061104:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2351:x1874380416102144:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548672.062066:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2351:x1874380416102144:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 956us (2845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548672.062076:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 31 00000100:00080000:0.0:1787548672.062529:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787548672.062535:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787548672.062538:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787548672.435387:0:10322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg613-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787548672.453733:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548673.476341:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548673.542642:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec87e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431862016:0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.542713:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548673.542759:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431862528:0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.542784:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548673.542807:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787548673.542812:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec87e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431862400:0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.542834:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548673.542859:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec87e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431862144:0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.542878:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548673.542891:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431862656:0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.542909:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548673.542922:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787548673.542927:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec87e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431862272:0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.542948:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548673.542961:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431862784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548673.542980:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548673.543018:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431862016 00000100:00100000:0.0:1787548673.543024:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431862016 00000100:00100000:0.0:1787548673.543078:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787548673.543087:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3316:x1874380431862016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.543147:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3316:x1874380431862016:12345-0@lo:400:kworker.0 Request processed in 61us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548673.543154:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787548673.543183:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431862528 00000100:00100000:0.0:1787548673.543188:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431862528 00000100:00100000:0.0:1787548673.543217:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431862144 00000100:00100000:0.0:1787548673.543228:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431862144 00000100:00100000:0.0:1787548673.543253:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431862272 00000100:00100000:0.0:1787548673.543256:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431862272 00000100:00100000:0.0:1787548673.543273:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787548673.543279:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431862528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.543313:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431862528:12345-0@lo:400:kworker.0 Request processed in 34us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548673.543319:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787548673.543329:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787548673.543334:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431862144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.543363:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431862144:12345-0@lo:400:kworker.0 Request processed in 29us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548673.543369:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787548673.543378:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787548673.543383:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec88299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431862272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.543407:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec88299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431862272:12345-0@lo:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548673.543413:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787548673.543430:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431862400 00000100:00100000:0.0:1787548673.543434:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431862400 00000100:00100000:0.0:1787548673.543456:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431862656 00000100:00100000:0.0:1787548673.543458:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431862656 00000100:00100000:0.0:1787548673.543474:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787548673.543480:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431862400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.543509:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431862400:12345-0@lo:400:kworker.0 Request processed in 29us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548673.543515:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787548673.543532:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787548673.543538:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec88298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431862656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.543566:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec88298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431862656:12345-0@lo:400:kworker.0 Request processed in 29us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548673.543571:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787548673.543595:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431862784 00000100:00100000:0.0:1787548673.543599:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431862784 00000100:00100000:0.0:1787548673.543621:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787548673.543626:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec88298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431862784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787548673.543650:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548673.543679:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec88298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431862784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548673.543685:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787548673.543700:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787548673.543703:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787548673.543705:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548673.543742:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec87e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431862272:0@lo:400:kworker.0 00010000:00080000:0.0:1787548673.543754:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec90094700 x1874380431862784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548673.543769:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431862784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548673.543778:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec87e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431862144:0@lo:400:kworker.0 00010000:00080000:0.0:1787548673.543786:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec90095f80 x1874380431862656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548673.543793:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431862656:0@lo:400:kworker.0 00010000:00080000:0.0:1787548673.543837:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec87e91c00 x1874380431862400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548673.543854:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec87e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431862400:0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.543864:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec87e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431862016:0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.543875:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431862528:0@lo:400:kworker.0 00000100:00100000:0.0:1787548673.544836:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431862912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548673.544885:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548673.547702:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431862912 00000100:00100000:3.0:1787548673.547713:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431862912 00000100:00100000:3.0:1787548673.547768:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787548673.547778:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431862912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787548673.547812:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548673.547892:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431862912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (3006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548673.547899:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1787548673.547992:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8833ce00 x1874380431862912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548673.548024:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431862912:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787548674.499565:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548675.523229:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548676.549510:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548677.180516:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548677.180554:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548677.180593:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548677.180617:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548677.180645:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548677.180713:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416102912 00000100:00100000:3.0:1787548677.180731:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416102912 00000100:00100000:3.0:1787548677.180789:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416102784 00000100:00100000:3.0:1787548677.180791:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416102784 00000100:00100000:3.0:1787548677.180810:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 34 00000100:00100000:3.0:1787548677.180819:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2352:x1874380416102912:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548677.180881:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2352:x1874380416102912:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 63us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548677.180888:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 34 00000100:00100000:3.0:1787548677.180902:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 35 00000100:00100000:3.0:1787548677.180908:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2352:x1874380416102784:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548677.180937:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2352:x1874380416102784:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 30us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548677.180943:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 35 00000100:00100000:1.0:1787548677.181240:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416102656 00000100:00100000:1.0:1787548677.181245:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416102656 00000100:00100000:1.0:1787548677.181276:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416102528 00000100:00100000:1.0:1787548677.181278:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416102528 00000100:00100000:1.0:1787548677.181306:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 66 00000100:00100000:1.0:1787548677.181312:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+5:2352:x1874380416102656:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548677.181343:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+5:2352:x1874380416102656:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 32us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548677.181349:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 66 00000100:00100000:1.0:1787548677.181360:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 67 00000100:00100000:1.0:1787548677.181365:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416102528:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548677.181382:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416102528:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 17us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548677.181388:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 67 00000100:00080000:2.0:1787548677.185185:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787548677.185196:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787548677.185199:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787548677.185523:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416102400 00000100:00100000:0.0:1787548677.185534:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416102400 00000100:00100000:0.0:1787548677.185618:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 219 00000100:00100000:0.0:1787548677.185631:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2352:x1874380416102400:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548677.185722:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2352:x1874380416102400:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 94us (5213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548677.185731:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 219 00010000:00010000:0.0:1787548677.574290:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548678.595548:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548678.659717:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431863040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548678.659798:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548678.660288:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431863040 00000100:00100000:2.0:1787548678.660298:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431863040 00000100:00100000:2.0:1787548678.660361:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787548678.660371:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431863040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787548678.660420:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548678.660472:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431863040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548678.660481:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787548678.660508:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787548678.660803:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8833dc00 x1874380431863040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548678.660846:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431863040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787548678.661486:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431863424:0@lo:400:kworker.0 00000100:00100000:2.0:1787548678.661561:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548678.661601:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431863168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548678.661657:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548678.661705:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431863680:0@lo:400:kworker.0 00000100:00100000:1.0:1787548678.661771:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431863168 00000100:00100000:1.0:1787548678.661777:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431863168 00000100:00100000:1.0:1787548678.661827:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787548678.661836:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431863168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787548678.661864:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548678.661905:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431863168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548678.661912:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787548678.661966:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787548678.662310:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431863424 00000100:00100000:1.0:1787548678.662323:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431863424 00000100:00100000:1.0:1787548678.662368:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787548678.662379:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431863424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548678.662406:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787548678.662422:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431863552:0@lo:400:kworker.0 00000100:00100000:1.0:1787548678.662430:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431863424:12345-0@lo:400:kworker.0 Request processed in 52us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548678.662440:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787548678.662470:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548678.662563:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431863296:0@lo:400:kworker.0 00000100:00100000:0.0:1787548678.663223:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548678.669004:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548678.669082:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431863808:0@lo:400:kworker.0 00000100:00100000:2.0:1787548678.669340:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431863424:0@lo:400:kworker.0 00000100:00100000:3.0:1787548678.669522:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548678.669568:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431863296 00000100:00100000:3.0:1787548678.669576:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431863296 00000100:00100000:3.0:1787548678.669636:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787548678.669646:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3314:x1874380431863296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548678.669721:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3314:x1874380431863296:12345-0@lo:400:kworker.0 Request processed in 77us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548678.669729:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787548678.669770:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431863808 00000100:00100000:3.0:1787548678.669774:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431863808 00000100:00100000:3.0:1787548678.669802:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787548678.669809:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431863808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548678.669845:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431863808:12345-0@lo:400:kworker.0 Request processed in 37us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548678.669872:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787548678.669913:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431863296:0@lo:400:kworker.0 00010000:00080000:3.0:1787548678.669928:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec90bd3100 x1874380431863808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548678.669940:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431863808:0@lo:400:kworker.0 00000100:00100000:1.0:1787548678.670718:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431863552 00000100:00100000:1.0:1787548678.670735:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431863552 00000100:00100000:1.0:1787548678.670815:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431863680 00000100:00100000:1.0:1787548678.670819:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431863680 00000100:00100000:1.0:1787548678.670844:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787548678.670852:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431863552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548678.670945:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431863552:12345-0@lo:400:kworker.0 Request processed in 94us (8478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548678.670952:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787548678.670968:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787548678.670974:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431863680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548678.671016:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431863680:12345-0@lo:400:kworker.0 Request processed in 42us (7796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548678.671022:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1787548678.671071:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548678.673240:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431863680:0@lo:400:kworker.0 00010000:00080000:0.0:1787548678.673291:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feb81a84000 x1874380431863168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548678.673310:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431863168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548678.673540:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431863552:0@lo:400:kworker.0 00010000:00010000:0.0:1787548679.619590:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548680.648332:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548681.669681:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548682.295473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548682.295517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548682.295604:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548682.295633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548682.295656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548682.295707:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416103168 00000100:00100000:1.0:1787548682.295717:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416103168 00000100:00100000:1.0:1787548682.295773:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416103296 00000100:00100000:1.0:1787548682.295776:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416103296 00000100:00100000:1.0:1787548682.295797:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 71 00000100:00100000:1.0:1787548682.295806:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2354:x1874380416103168:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548682.295871:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2354:x1874380416103168:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 66us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548682.295879:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 71 00000100:00100000:1.0:1787548682.295908:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 72 00000100:00100000:1.0:1787548682.295927:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416103296:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548682.295953:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416103296:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 27us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548682.295959:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 72 00000100:00080000:1.0:1787548682.295990:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548682.296240:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416103040 00000100:00100000:2.0:1787548682.296245:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416103040 00000100:00100000:2.0:1787548682.296283:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 221 00000100:00100000:2.0:1787548682.296290:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2354:x1874380416103040:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548682.296333:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2354:x1874380416103040:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 33us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548682.296339:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 221 00000100:00100000:0.0:1787548682.305224:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416103424 00000100:00100000:0.0:1787548682.305240:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416103424 00000100:00100000:0.0:1787548682.305387:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416103552 00000100:00100000:0.0:1787548682.305391:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416103552 00000100:00080000:2.0:1787548682.305445:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787548682.305449:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548682.305856:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 37 00000100:00100000:1.0:1787548682.305881:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416103424:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548682.305980:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416103424:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 104us (10462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548682.305987:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 37 00000100:00100000:1.0:1787548682.306004:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 38 00000100:00100000:1.0:1787548682.306012:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416103552:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548682.306036:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416103552:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 26us (10380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548682.306043:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 38 00010000:00010000:2.0:1787548682.692040:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548683.726794:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548683.780009:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec87e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431864192:0@lo:400:kworker.0 00000100:00100000:0.0:1787548683.780075:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548683.780160:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787548683.780167:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec87e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431864320:0@lo:400:kworker.0 00000100:00100000:0.0:1787548683.780196:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548683.780235:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431864192 00000100:00100000:0.0:1787548683.780243:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431864192 00000100:00100000:0.0:1787548683.780295:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787548683.780305:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431864192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548683.780354:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431864192:12345-0@lo:400:kworker.0 Request processed in 51us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548683.780362:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787548683.780406:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431864320 00000100:00100000:0.0:1787548683.780410:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431864320 00000100:00100000:0.0:1787548683.780454:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787548683.780462:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431864320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548683.780492:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431864320:12345-0@lo:400:kworker.0 Request processed in 32us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548683.780499:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787548683.780519:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787548683.780527:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431864704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548683.780564:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548683.780589:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431864704 00000100:00100000:0.0:1787548683.780593:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431864704 00000100:00100000:0.0:1787548683.780618:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787548683.780625:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431864704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787548683.780649:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548683.780682:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431864704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548683.780688:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787548683.780721:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8370dc00 x1874380431864704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548683.780738:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431864704:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787548683.780764:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec87e93800 x1874380431864320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548683.780773:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec87e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431864320:0@lo:400:kworker.0 00000100:00100000:0.0:1787548683.780784:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec87e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431864192:0@lo:400:kworker.0 00000100:00100000:2.0:1787548683.780855:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec87e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431864064:0@lo:400:kworker.0 00000100:00100000:2.0:1787548683.780884:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548683.780909:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431864576:0@lo:400:kworker.0 00000100:00100000:2.0:1787548683.780928:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548683.780953:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787548683.780971:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec87e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431863936:0@lo:400:kworker.0 00000100:00100000:2.0:1787548683.780996:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548683.781017:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431864448:0@lo:400:kworker.0 00000100:00100000:2.0:1787548683.781037:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787548683.781058:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787548683.781062:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787548683.781065:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548683.781073:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431864576 00000100:00100000:2.0:1787548683.781077:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431864576 00000100:00100000:2.0:1787548683.781101:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787548683.781107:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431864576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548683.781157:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431864576:12345-0@lo:400:kworker.0 Request processed in 50us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548683.781163:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787548683.781180:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431863936 00000100:00100000:2.0:1787548683.781184:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431863936 00000100:00100000:2.0:1787548683.781204:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787548683.781210:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3316:x1874380431863936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548683.781237:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3316:x1874380431863936:12345-0@lo:400:kworker.0 Request processed in 27us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548683.781243:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787548683.781267:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431864064 00000100:00100000:2.0:1787548683.781271:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431864064 00000100:00100000:2.0:1787548683.781290:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431864448 00000100:00100000:2.0:1787548683.781293:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431864448 00000100:00100000:2.0:1787548683.781316:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787548683.781321:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431864064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548683.781357:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431864064:12345-0@lo:400:kworker.0 Request processed in 35us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548683.781362:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787548683.781373:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787548683.781378:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431864448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548683.781398:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431864448:12345-0@lo:400:kworker.0 Request processed in 21us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548683.781403:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787548683.781425:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec87e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431863936:0@lo:400:kworker.0 00000100:00100000:2.0:1787548683.781434:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431864448:0@lo:400:kworker.0 00000100:00100000:2.0:1787548683.781440:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec87e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431864064:0@lo:400:kworker.0 00010000:00080000:2.0:1787548683.781448:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8370d180 x1874380431864576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548683.781456:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431864576:0@lo:400:kworker.0 00000100:00080000:2.0:1787548683.781475:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787548683.783574:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787548683.783594:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431864832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548683.783653:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548683.783803:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431864832 00000100:00100000:2.0:1787548683.783811:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431864832 00000100:00100000:2.0:1787548683.783859:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787548683.783869:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431864832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787548683.783901:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548683.783948:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431864832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548683.783965:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1787548683.784029:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8833dc00 x1874380431864832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548683.784046:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431864832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787548684.739316:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548685.766272:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548686.787344:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548687.417773:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548687.417817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548687.417846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548687.417926:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416103808 00000100:00100000:1.0:1787548687.417954:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416103808 00000100:00100000:1.0:1787548687.418010:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416103936 00000100:00100000:1.0:1787548687.418013:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416103936 00000100:00100000:1.0:1787548687.418031:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 76 00000100:00100000:1.0:1787548687.418039:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416103808:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548687.418114:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416103808:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 75us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548687.418121:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 76 00000100:00100000:1.0:1787548687.418158:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 77 00000100:00100000:1.0:1787548687.418164:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92088e20-066b-499e-ac52-ab10992c506a+5:2352:x1874380416103936:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548687.418185:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92088e20-066b-499e-ac52-ab10992c506a+5:2352:x1874380416103936:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 22us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548687.418191:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 77 00000100:00080000:2.0:1787548687.418445:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548687.418618:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416103680 00000100:00100000:3.0:1787548687.418623:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416103680 00000100:00100000:3.0:1787548687.418665:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 223 00000100:00100000:3.0:1787548687.418672:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2352:x1874380416103680:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548687.418715:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2352:x1874380416103680:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 43us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548687.418721:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 223 00000100:00100000:2.0:1787548687.420693:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548687.420745:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548687.420869:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416104064 00000100:00100000:3.0:1787548687.420877:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416104064 00000100:00100000:3.0:1787548687.420947:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416104192 00000100:00100000:3.0:1787548687.420951:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416104192 00000100:00100000:3.0:1787548687.420975:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:3.0:1787548687.420984:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92088e20-066b-499e-ac52-ab10992c506a+5:2350:x1874380416104064:12345-192.168.206.13@tcp:9:kworker.0 00000020:00000080:3.0:1787548687.421007:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e8bf 00000100:00080000:3.0:1787548687.421015:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8fecbd0b0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787548687.421074:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787548687.421416:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92088e20-066b-499e-ac52-ab10992c506a+2:2350:x1874380416104064:12345-192.168.206.13@tcp:9:kworker.0 Request processed in 432us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548687.421424:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:3.0:1787548687.421440:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 15 00000100:00100000:3.0:1787548687.421447:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92088e20-066b-499e-ac52-ab10992c506a+5:2350:x1874380416104192:12345-192.168.206.13@tcp:9:kworker.0 00000020:00000080:3.0:1787548687.421458:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e8c6 00000100:00080000:3.0:1787548687.421463:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8fecbd0b0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787548687.421482:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787548687.421668:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92088e20-066b-499e-ac52-ab10992c506a+2:2350:x1874380416104192:12345-192.168.206.13@tcp:9:kworker.0 Request processed in 221us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548687.421676:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 15 00010000:00010000:0.0:1787548687.422118:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548687.422245:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787548687.422774:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787548687.422779:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787548687.814641:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787548687.920970:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 92088e20-066b-499e-ac52-ab10992c506a 00000020:00000080:2.0:1787548687.920979:0:7647:0:(genops.c:885:class_export_put()) final put ffff8fecbd0b2000/92088e20-066b-499e-ac52-ab10992c506a 00000020:00000080:3.0:1787548687.921046:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecbd0b2000/92088e20-066b-499e-ac52-ab10992c506a for lustre-OST0001 00000020:00000080:3.0:1787548687.921107:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fecbd0b0800 for lustre-OST0001 00000001:02000400:0.0:1787548688.502751:0:11022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787548688.836672:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548688.899433:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787548688.899454:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431864960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548688.899519:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548688.900027:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431865344:0@lo:400:kworker.0 00000100:00100000:3.0:1787548688.900061:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548688.900081:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787548688.900087:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431865216:0@lo:400:kworker.0 00000100:00100000:3.0:1787548688.900114:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548688.900155:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad09b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431865728:0@lo:400:kworker.0 00000100:00100000:3.0:1787548688.900178:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548688.900206:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431865728 00000100:00100000:3.0:1787548688.900213:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431865728 00000100:00100000:3.0:1787548688.900278:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787548688.900287:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431865728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548688.900338:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431865728:12345-0@lo:400:kworker.0 Request processed in 52us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548688.900345:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787548688.900384:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecad09b100 x1874380431865728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548688.900411:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad09b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431865728:0@lo:400:kworker.0 00000100:00100000:3.0:1787548688.900433:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431865088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548688.900456:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548688.900475:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431865600:0@lo:400:kworker.0 00000100:00100000:3.0:1787548688.900494:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548688.900510:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787548688.900516:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874380431865472:0@lo:400:kworker.0 00000100:00100000:3.0:1787548688.900536:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548688.900560:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431864960 00000100:00100000:3.0:1787548688.900564:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431864960 00000100:00100000:3.0:1787548688.900585:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431865088 00000100:00100000:3.0:1787548688.900588:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431865088 00000100:00100000:3.0:1787548688.900615:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787548688.900622:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431864960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787548688.900649:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548688.900684:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431864960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548688.900691:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787548688.900703:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787548688.900716:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431865088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787548688.900735:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548688.900762:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431865088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548688.900983:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431865216 00000100:00100000:2.0:1787548688.900987:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431865216 00000100:00100000:2.0:1787548688.901017:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787548688.901024:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3314:x1874380431865216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548688.901058:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3314:x1874380431865216:12345-0@lo:400:kworker.0 Request processed in 36us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548688.901064:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:2.0:1787548688.901089:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787548688.901092:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787548688.901110:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431865216:0@lo:400:kworker.0 00000100:00100000:2.0:1787548688.901166:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431865344 00000100:00100000:2.0:1787548688.901169:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431865344 00000100:00100000:2.0:1787548688.901192:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431865600 00000100:00100000:2.0:1787548688.901194:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431865600 00000100:00100000:2.0:1787548688.901210:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431865472 00000100:00100000:2.0:1787548688.901212:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431865472 00000100:00100000:2.0:1787548688.901224:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787548688.901229:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431865344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548688.901270:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431865344:12345-0@lo:400:kworker.0 Request processed in 40us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548688.901276:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787548688.901287:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787548688.901292:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431865600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548688.901312:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431865600:12345-0@lo:400:kworker.0 Request processed in 21us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548688.901317:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787548688.901324:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787548688.901329:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874380431865472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548688.901347:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874380431865472:12345-0@lo:400:kworker.0 Request processed in 18us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548688.901351:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1787548688.901365:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548688.901379:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431865344:0@lo:400:kworker.0 00000100:00100000:1.0:1787548688.901514:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874380431865472:0@lo:400:kworker.0 00010000:00080000:1.0:1787548688.901525:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8370dc00 x1874380431865088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548688.901539:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431865088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548688.901547:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431865600:0@lo:400:kworker.0 00010000:00080000:1.0:1787548688.901556:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feb81a85180 x1874380431864960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548688.901564:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431864960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548688.901700:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1787548689.859791:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787548689.994479:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 92088e20-066b-499e-ac52-ab10992c506a 00000020:00000080:1.0:1787548689.994487:0:6716:0:(genops.c:885:class_export_put()) final put ffff8fecbd0b5800/92088e20-066b-499e-ac52-ab10992c506a 00000020:00000080:3.0:1787548689.994553:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecbd0b5800/92088e20-066b-499e-ac52-ab10992c506a for lustre-OST0000 00000020:00000080:3.0:1787548689.994606:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fecbd0b0000 for lustre-OST0000 00010000:00010000:0.0:1787548690.891332:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787548691.645566:0:11170:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1dba6b80 20000000:00000080:3.0:1787548691.645582:0:11170:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8feb81f31400 uarg=0000000000000000 20000000:01000000:3.0:1787548691.645616:0:11170:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787548691.645622:0:11170:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787548691.645626:0:11170:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787548691.646472:0:11171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787548691.646619:0:11170:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787548691.651999:0:11170:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787548691.652028:0:11170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.652046:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fecbd22f800/0xcb7c48919424e879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e872 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.652055:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fecbd22fa00/0xcb7c48919424e887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e880 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.652061:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fecc21ec400/0xcb7c48919424e895 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e88e expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.652285:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec90150e00/0xcb7c48919424e89c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2141 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.652294:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e8b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2179 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.652312:0:11170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.652354:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e8b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2179 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.652369:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e8b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2179 expref: 12 pid: 5849 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548691.652384:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874380431865856:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548691.652503:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec90150e00/0xcb7c48919424e89c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2141 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.652512:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fec90150e00/0xcb7c48919424e89c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2141 expref: 12 pid: 5846 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548691.652520:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874380431865984:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548691.652554:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fecc21ec400/0xcb7c48919424e895 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e88e expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.652563:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fecc21ec400/0xcb7c48919424e895 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e88e expref: 18 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548691.652571:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874380431866112:0@lo:104: 00000100:00100000:3.0:1787548691.652610:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787548691.652647:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fecbd22fa00/0xcb7c48919424e887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e880 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.652665:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fecbd22fa00/0xcb7c48919424e887 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e880 expref: 18 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548691.652672:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874380431866240:0@lo:104: 00000100:00100000:3.0:1787548691.652693:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787548691.652712:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fecbd22f800/0xcb7c48919424e879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e872 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.652720:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fecbd22f800/0xcb7c48919424e879 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e872 expref: 18 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548691.652728:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874380431866368:0@lo:104: 00000100:00100000:3.0:1787548691.652748:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548691.652758:0:11170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb4780 going to sleep for 11 seconds 00000100:00100000:0.0:1787548691.652825:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431866112 00000100:00100000:0.0:1787548691.652833:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431866112 00000100:00100000:0.0:1787548691.652867:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431866240 00000100:00100000:0.0:1787548691.652870:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431866240 00000100:00100000:0.0:1787548691.652889:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431866368 00000100:00100000:0.0:1787548691.652891:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431866368 00000100:00100000:0.0:1787548691.652904:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787548691.652912:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+5:11170:x1874380431866112:12345-0@lo:104: 00010000:00010000:0.0:1787548691.652936:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e895 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.652998:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787548691.653004:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+5:11170:x1874380431866112:12345-0@lo:104: Request processed in 92us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548691.653010:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787548691.653027:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787548691.653032:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+4:11170:x1874380431866240:12345-0@lo:104: 00010000:00010000:0.0:1787548691.653039:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e887 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653082:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787548691.653087:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+4:11170:x1874380431866240:12345-0@lo:104: Request processed in 55us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548691.653093:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787548691.653106:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787548691.653112:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:11170:x1874380431866368:12345-0@lo:104: 00010000:00010000:0.0:1787548691.653119:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e879 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653177:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787548691.653183:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:11170:x1874380431866368:12345-0@lo:104: Request processed in 71us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548691.653198:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787548691.653216:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787548691.653222:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e895 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653230:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec81534600 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:0.0:1787548691.653234:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e895 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653242:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e895 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787548691.653249:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e895 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548691.653255:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787548691.653284:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e895 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653290:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787548691.653306:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e895 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653313:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec81534600/0xcb7c48919424e88e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e895 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653324:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787548691.653328:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e887 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653344:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22ea00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:0.0:1787548691.653347:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e887 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653354:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e887 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787548691.653361:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e887 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548691.653366:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787548691.653379:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e887 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653385:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787548691.653399:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e887 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653406:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ea00/0xcb7c48919424e880 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e887 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653415:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548691.653418:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e879 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653423:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec81535400 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:0.0:1787548691.653426:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e879 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653443:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e879 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787548691.653449:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e879 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548691.653453:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787548691.653467:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e879 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653473:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787548691.653478:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e879 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653485:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec81535400/0xcb7c48919424e872 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e879 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653498:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548691.653500:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548691.653502:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548691.653507:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548691.653514:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787548691.653524:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431866496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787548691.653555:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548691.653582:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431866496 00000100:00100000:0.0:1787548691.653586:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431866496 00010000:00010000:0.0:1787548691.653605:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fecc21ec400/0xcb7c48919424e895 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e88e expref: 19 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548691.653624:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787548691.653638:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431866496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787548691.653648:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548691.653653:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fecc21ec400/0xcb7c48919424e895 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e88e expref: 19 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653662:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fecc21ec400/0xcb7c48919424e895 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e88e expref: 19 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.653675:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548691.653703:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431866496:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548691.653709:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787548691.653762:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431866496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787548691.653863:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21ec400/0xcb7c48919424e895 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e88e expref: 18 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548691.653875:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874380431866112:0@lo:104: 00000100:00100000:3.0:1787548691.653883:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874380431866240:0@lo:104: 00000100:00100000:3.0:1787548691.653889:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874380431866368:0@lo:104: 00010000:00010000:2.0:1787548691.654059:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548691.657908:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431866624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787548691.657987:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548691.658086:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787548691.658093:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431866752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787548691.658118:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548691.658709:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874380431865856:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548691.658721:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874380431865984:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548691.658762:0:11170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548691.659090:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548691.659355:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431866624 00000100:00100000:0.0:1787548691.659362:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431866624 00010000:00010000:0.0:1787548691.659396:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fecbd22fa00/0xcb7c48919424e887 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e880 expref: 18 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548691.659431:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431866752 00000100:00100000:0.0:1787548691.659435:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431866752 00010000:00010000:0.0:1787548691.659449:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fecbd22f800/0xcb7c48919424e879 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e872 expref: 19 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548691.659470:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787548691.659478:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431866624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787548691.659490:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548691.659495:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fecbd22fa00/0xcb7c48919424e887 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e880 expref: 19 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.659517:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fecbd22fa00/0xcb7c48919424e887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e880 expref: 19 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.659533:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecbd22fa00/0xcb7c48919424e887 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e880 expref: 19 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.659547:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548691.659602:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+18:3315:x1874380431866624:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548691.659609:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787548691.659627:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787548691.659634:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+17:3315:x1874380431866752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787548691.659642:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548691.659647:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fecbd22f800/0xcb7c48919424e879 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e872 expref: 17 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.659655:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fecbd22f800/0xcb7c48919424e879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e872 expref: 17 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.659665:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecbd22f800/0xcb7c48919424e879 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e872 expref: 17 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548691.659673:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548691.659695:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+16:3315:x1874380431866752:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548691.659700:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787548691.659776:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431866752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787548691.659784:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431866624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787548691.661304:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548691.661577:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416104320 00000100:00100000:2.0:1787548691.661586:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416104320 00010000:00010000:2.0:1787548691.661619:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e8b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2179 expref: 13 pid: 5849 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548691.661641:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416104448 00000100:00100000:2.0:1787548691.661644:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416104448 00010000:00010000:2.0:1787548691.661656:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec90150e00/0xcb7c48919424e89c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2141 expref: 14 pid: 5846 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548691.661671:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 28 00000100:00100000:2.0:1787548691.661693:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:450a7108-39f6-4004-8f60-5d2336e0cad2+14:2352:x1874380416104320:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548691.661706:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548691.661712:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e8b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2179 expref: 14 pid: 5849 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548691.661724:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e8b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2179 expref: 14 pid: 5849 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548691.661749:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424e8b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2179 expref: 14 pid: 5849 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548691.661763:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548691.662376:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 29 00000100:00100000:3.0:1787548691.662388:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2352:x1874380416104448:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548691.662398:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548691.662404:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec90150e00/0xcb7c48919424e89c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2141 expref: 13 pid: 5846 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.662414:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec90150e00/0xcb7c48919424e89c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2141 expref: 13 pid: 5846 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.662426:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec90150e00/0xcb7c48919424e89c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2141 expref: 13 pid: 5846 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.662438:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.662446:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.662461:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.662468:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.662475:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.662482:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.662501:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec80031a00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548691.662505:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.662513:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.662527:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.662538:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548691.662569:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:450a7108-39f6-4004-8f60-5d2336e0cad2+12:2352:x1874380416104448:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 184us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548691.662576:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 29 00010000:00010000:3.0:1787548691.662605:0:11170:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.662613:0:11170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548691.662619:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec80031a00/0xcb7c48919424e8cd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548691.663764:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:450a7108-39f6-4004-8f60-5d2336e0cad2+11:2352:x1874380416104320:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 122us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548691.663777:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 28 00010000:00010000:0.0:1787548691.907320:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548692.549618:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548692.549672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548692.549699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548692.549909:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416104576 00000100:00100000:3.0:1787548692.549929:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416104576 00000100:00100000:3.0:1787548692.549986:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 225 00000100:00100000:3.0:1787548692.549998:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+11:2354:x1874380416104576:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548692.550077:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+11:2354:x1874380416104576:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 69us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548692.550098:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 225 00000100:00100000:1.0:1787548692.550967:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416104704 00000100:00100000:1.0:1787548692.550975:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416104704 00000100:00100000:1.0:1787548692.551035:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416104832 00000100:00100000:1.0:1787548692.551039:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416104832 00000100:00100000:1.0:1787548692.551076:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 81 00000100:00100000:1.0:1787548692.551084:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2354:x1874380416104704:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548692.551160:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2354:x1874380416104704:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 76us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548692.551167:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 81 00000100:00100000:1.0:1787548692.551183:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 82 00000100:00100000:1.0:1787548692.551190:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2353:x1874380416104832:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548692.551216:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2353:x1874380416104832:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 27us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548692.551223:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 82 00000100:00080000:2.0:1787548692.551352:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787548692.933004:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787548693.124303:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787548693.124317:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fec88445800 from 7 10000000:01000000:0.0:1787548693.124323:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787548693.124383:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548693.124397:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548693.124412:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548693.124444:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431866880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787548693.124529:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548693.124588:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb81083cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548693.125126:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431866880 00000100:00100000:2.0:1787548693.126123:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431866880 00000100:00100000:2.0:1787548693.126283:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787548693.126296:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431866880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548693.126318:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548693.126341:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e8db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e8d4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548693.126375:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e8db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e8d4 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548693.126398:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e8db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e8d4 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548693.126411:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ed000, rc 0) 00000100:00100000:2.0:1787548693.126498:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431866880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548693.126506:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787548693.126576:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431866880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548693.126603:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e8db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548693.126614:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e8db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548693.128606:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548693.128690:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548693.128793:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9070ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787548693.130977:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431867008 00000100:00100000:3.0:1787548693.130993:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431867008 00000100:00100000:3.0:1787548693.131116:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787548693.131153:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431867008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548693.132492:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431867008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1362us (3799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548693.132504:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787548693.132735:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548693.132799:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787548693.132871:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548693.138120:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9070ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787548693.139451:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431867136 00000100:00100000:0.0:1787548693.139469:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431867136 00000100:00100000:0.0:1787548693.139531:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787548693.139542:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431867136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787548693.139992:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431867136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 449us (7127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548693.140002:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787548693.141997:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787548693.144546:0:11219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787548693.144644:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787548693.144668:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787548693.144683:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e8db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548693.144697:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e8db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548693.144708:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787548693.144712:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fecad08a800 from 7 10000000:01000000:3.0:1787548693.144715:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787548693.144762:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548693.144772:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548693.144786:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548693.145000:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787548693.145348:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548693.145407:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787548693.145921:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431867264 00000100:00100000:1.0:1787548693.145938:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431867264 00000100:00100000:1.0:1787548693.146005:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787548693.146017:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431867264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787548693.146035:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548693.146051:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbd22ea00/0xcb7c48919424e8e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e8e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548693.146242:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbd22ea00/0xcb7c48919424e8e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e8e2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548693.146257:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbd22ea00/0xcb7c48919424e8e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e8e2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548693.146269:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22ea00, rc 0) 00000100:00100000:1.0:1787548693.146334:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431867264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 320us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548693.146342:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787548693.146969:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787548693.146992:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e8e9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548693.147004:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e8e9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548693.147243:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548693.147295:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548693.147324:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787548693.147421:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431867392 00000100:00100000:2.0:1787548693.147427:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431867392 00000100:00100000:2.0:1787548693.147479:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787548693.147489:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431867392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548693.147927:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548693.147965:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787548693.148007:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548693.148033:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb4000 going to sleep for 11 seconds 00000100:00100000:3.0:1787548693.148047:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431867520 00000100:00100000:3.0:1787548693.148051:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431867520 00000100:00100000:3.0:1787548693.148962:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787548693.148976:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431867520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787548693.149237:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431867392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548693.149247:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787548693.149506:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431867520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 533us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548693.149513:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787548693.149660:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787548693.159975:0:11220:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787548693.160305:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787548693.160335:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787548693.160349:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e8e9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548693.160364:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e8e9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548693.160375:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787548693.160378:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fec8644c800 from 7 10000000:01000000:3.0:1787548693.160381:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787548693.160432:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548693.160440:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548693.160453:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548693.160483:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787548693.160567:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548693.160613:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb4300 going to sleep for 11 seconds 00000100:00100000:2.0:1787548693.160749:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431867648 00000100:00100000:2.0:1787548693.160758:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431867648 00000100:00100000:2.0:1787548693.160818:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787548693.160829:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431867648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548693.160844:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548693.160859:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e8f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424e8f0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548693.160886:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e8f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424e8f0 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548693.160897:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e8f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e8f0 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548693.160907:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ec200, rc 0) 00000100:00100000:2.0:1787548693.160966:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431867648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548693.160974:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787548693.161237:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787548693.161256:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e8f7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548693.161267:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e8f7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548693.161359:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548693.161390:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548693.161412:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb4300 going to sleep for 11 seconds 00000100:00100000:3.0:1787548693.161429:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431867776 00000100:00100000:3.0:1787548693.161433:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431867776 00000100:00100000:3.0:1787548693.161458:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787548693.161466:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431867776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548693.161768:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431867776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548693.161776:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787548693.161820:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548693.161848:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787548693.161888:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548693.161900:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb4300 going to sleep for 11 seconds 00000100:00100000:3.0:1787548693.161923:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431867904 00000100:00100000:3.0:1787548693.161927:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431867904 00000100:00100000:3.0:1787548693.161944:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787548693.161949:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431867904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787548693.162108:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431867904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548693.162114:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787548693.162168:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431867904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787548693.162835:0:11222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787548693.162926:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787548693.162942:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787548693.162951:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e8f7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548693.162962:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e8f7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548693.504096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548693.504227:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416104960 00000100:00100000:2.0:1787548693.504242:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416104960 00000100:00100000:2.0:1787548693.504307:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 235 00000100:00100000:2.0:1787548693.504320:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+11:5595:x1874380416104960:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548693.504352:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548693.504376:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecc21edc00/0xcb7c48919424e8fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a21a3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548693.504423:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecc21edc00/0xcb7c48919424e8fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21a3 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548693.504435:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecc21edc00/0xcb7c48919424e8fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21a3 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548693.504446:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21edc00, rc 0) 00000100:00100000:2.0:1787548693.504526:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+12:5595:x1874380416104960:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 Request processed in 208us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548693.504534:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 235 00000100:00100000:2.0:1787548693.510932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548693.511754:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416105088 00000100:00100000:1.0:1787548693.511769:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416105088 00000100:00100000:1.0:1787548693.511837:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 236 00000100:00100000:1.0:1787548693.511850:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+12:5595:x1874380416105088:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787548693.512263:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+12:5595:x1874380416105088:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 Request processed in 414us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548693.512273:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 236 00000100:00100000:1.0:1787548693.517430:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548693.517691:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416105216 00000100:00100000:2.0:1787548693.517708:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416105216 00000100:00100000:2.0:1787548693.517791:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 237 00000100:00100000:2.0:1787548693.517805:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+12:5595:x1874380416105216:12345-192.168.206.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787548693.518080:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+12:5595:x1874380416105216:12345-192.168.206.13@tcp:503:ll_cfg_requeue.0 Request processed in 277us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548693.518089:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 237 00000100:00100000:1.0:1787548693.530069:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548693.530224:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416105344 00000100:00100000:3.0:1787548693.530239:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416105344 00000100:00100000:3.0:1787548693.530311:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 238 00000100:00100000:3.0:1787548693.530324:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+12:5595:x1874380416105344:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787548693.530348:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548693.530369:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec80031800/0xcb7c48919424e905 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a21aa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548693.530405:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec80031800/0xcb7c48919424e905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21aa expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548693.530418:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec80031800/0xcb7c48919424e905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21aa expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548693.530430:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec80031800, rc 0) 00000100:00100000:3.0:1787548693.530508:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:5595:x1874380416105344:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 Request processed in 187us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548693.530516:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 238 00000100:00100000:1.0:1787548693.553985:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548693.554330:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416105472 00000100:00100000:2.0:1787548693.554343:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416105472 00000100:00100000:2.0:1787548693.554428:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 239 00000100:00100000:2.0:1787548693.554441:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:5595:x1874380416105472:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548693.554976:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:5595:x1874380416105472:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 Request processed in 534us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548693.554987:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 239 00000100:00100000:0.0:1787548693.563945:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548693.564050:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416105600 00000100:00100000:1.0:1787548693.564059:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416105600 00000100:00100000:1.0:1787548693.564112:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 240 00000100:00100000:1.0:1787548693.564121:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:5595:x1874380416105600:12345-192.168.206.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548693.564364:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:5595:x1874380416105600:12345-192.168.206.13@tcp:503:ll_cfg_requeue.0 Request processed in 243us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548693.564372:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 240 00010000:00010000:1.0:1787548693.955943:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548694.019347:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431868032:0@lo:400:kworker.0 00000100:00100000:3.0:1787548694.019409:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548694.019464:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431868544:0@lo:400:kworker.0 00000100:00100000:3.0:1787548694.019488:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548694.019514:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787548694.019519:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431868160:0@lo:400:kworker.0 00000100:00100000:3.0:1787548694.019536:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548694.019562:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431868032 00000100:00100000:3.0:1787548694.019569:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431868032 00000100:00100000:3.0:1787548694.019616:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431868160 00000100:00100000:3.0:1787548694.019619:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431868160 00000100:00100000:3.0:1787548694.019644:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787548694.019651:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431868032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548694.019691:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431868032:12345-0@lo:400:kworker.0 Request processed in 40us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548694.019697:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787548694.019712:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787548694.019717:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431868160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548694.019737:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431868160:12345-0@lo:400:kworker.0 Request processed in 21us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548694.019743:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787548694.019757:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431868544 00000100:00100000:3.0:1787548694.019760:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431868544 00000100:00100000:3.0:1787548694.019782:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787548694.019787:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431868544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548694.019810:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431868544:12345-0@lo:400:kworker.0 Request processed in 24us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548694.019816:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787548694.019836:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787548694.019845:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548694.019874:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431868160:0@lo:400:kworker.0 00000100:00100000:3.0:1787548694.019883:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431868032:0@lo:400:kworker.0 00010000:00080000:3.0:1787548694.019894:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca71d8380 x1874380431868544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548694.019915:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431868544:0@lo:400:kworker.0 00000100:00100000:3.0:1787548694.019952:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431868288:0@lo:400:kworker.0 00000100:00100000:3.0:1787548694.019974:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548694.019989:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787548694.019994:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431868416:0@lo:400:kworker.0 00000100:00100000:3.0:1787548694.020011:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548694.020028:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431868288 00000100:00100000:3.0:1787548694.020031:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431868288 00000100:00100000:3.0:1787548694.020054:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787548694.020060:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431868288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548694.020092:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431868288:12345-0@lo:400:kworker.0 Request processed in 32us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548694.020098:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787548694.020113:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787548694.020127:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca71db480 x1874380431868288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548694.020161:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431868288:0@lo:400:kworker.0 00000100:00100000:3.0:1787548694.020176:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431868416 00000100:00100000:3.0:1787548694.020179:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431868416 00000100:00100000:3.0:1787548694.020204:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787548694.020217:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431868416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548694.020254:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431868416:12345-0@lo:400:kworker.0 Request processed in 38us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548694.020260:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1787548694.020275:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548694.020291:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431868416:0@lo:400:kworker.0 00000100:00100000:1.0:1787548694.020519:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431868672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548694.020550:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548694.020592:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431868672 00000100:00100000:1.0:1787548694.020596:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431868672 00000100:00100000:1.0:1787548694.020623:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787548694.020631:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431868672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787548694.020657:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548694.020693:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431868672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548694.020700:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787548694.020728:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec90bd2d80 x1874380431868672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548694.020742:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431868672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548694.022786:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787548694.022805:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431868800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548694.022861:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548694.022973:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431868800 00000100:00100000:3.0:1787548694.022980:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431868800 00000100:00100000:3.0:1787548694.023021:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787548694.023030:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431868800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787548694.023062:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548694.023105:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431868800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548694.023111:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1787548694.023165:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec90095500 x1874380431868800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548694.023184:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431868800:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787548694.982444:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787548695.316827:0:11369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg613-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787548696.003366:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548697.027874:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548697.656836:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548697.656884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548697.656925:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548697.657055:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416105984 00000100:00100000:0.0:1787548697.657064:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416105984 00000100:00100000:0.0:1787548697.657122:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416105856 00000100:00100000:0.0:1787548697.657126:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416105856 00000100:00100000:0.0:1787548697.657181:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 86 00000100:00100000:0.0:1787548697.657198:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+5:2352:x1874380416105984:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548697.657277:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+5:2352:x1874380416105984:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 80us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548697.657284:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 86 00000100:00100000:0.0:1787548697.657300:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 87 00000100:00100000:0.0:1787548697.657306:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416105856:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548697.657329:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416105856:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 23us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548697.657335:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 87 00000100:00080000:1.0:1787548697.657761:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548697.658556:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416105728 00000100:00100000:2.0:1787548697.658566:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416105728 00000100:00100000:2.0:1787548697.658658:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 241 00000100:00100000:2.0:1787548697.658667:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2352:x1874380416105728:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548697.658728:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2352:x1874380416105728:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 61us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548697.658735:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 241 00010000:00010000:0.0:1787548698.053336:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787548698.729043:0:11469:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:18:18 (1787548698) === 00000100:00100000:1.0:1787548699.028298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548699.028353:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548699.028471:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416106240 00000100:00100000:2.0:1787548699.028482:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416106240 00000100:00100000:2.0:1787548699.028549:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 0 00000100:00100000:2.0:1787548699.028560:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:9680:x1874380416106240:12345-192.168.206.13@tcp:700:mkdir.0 00000100:00100000:2.0:1787548699.028661:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:9680:x1874380416106240:12345-192.168.206.13@tcp:700:mkdir.0 Request processed in 102us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548699.028670:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 0 00000100:00080000:1.0:1787548699.028808:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548699.028933:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416106112 00000100:00100000:0.0:1787548699.028939:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416106112 00000100:00100000:0.0:1787548699.028984:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:0.0:1787548699.028992:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416106112:12345-192.168.206.13@tcp:41:mkdir.0 00000004:00000024:0.0:1787548699.029020:0:5855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787548699.029086:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416106112:12345-192.168.206.13@tcp:41:mkdir.0 Request processed in 94us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548699.029380:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:1.0:1787548699.030408:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548699.030501:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416106496 00000100:00100000:3.0:1787548699.030513:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416106496 00000100:00100000:3.0:1787548699.030602:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 15 00000100:00100000:3.0:1787548699.030613:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:9680:x1874380416106496:12345-192.168.206.13@tcp:36:mkdir.0 00010000:00010000:3.0:1787548699.030680:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548699.030891:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec81535c00/0xcb7c48919424e7ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a212c expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.030925:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93100) 00010000:00010000:3.0:1787548699.031020:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787548699.031371:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e90c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.031386:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e90c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.031395:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e90c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.031437:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e913 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.031445:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e913 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.031453:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e913 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548699.035160:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787548699.035176:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e90c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.035186:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e90c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.035195:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e90c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.035211:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec80031200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548699.035216:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e90c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.035223:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e90c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.035241:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93400) 00010000:00010000:3.0:1787548699.035244:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548699.035248:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e90c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.035254:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e90c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787548699.035272:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083a8db23 reply state 0000000016ad87b4 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e913 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548699.035281:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787548699.035374:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:9680:x1874380416106496:12345-192.168.206.13@tcp:36:mkdir.0 Request processed in 4759us (4973us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787548699.035383:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 15 00010000:00010000:3.0:1787548699.038312:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e913 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.038329:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e913 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.038336:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e913 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.038354:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec80031e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548699.038359:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e913 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.038365:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e913 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.038381:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fec90d93700) 00010000:00010000:3.0:1787548699.038384:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548699.038388:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e913 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.038394:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e913 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548699.053644:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548699.054043:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416106624 00000100:00100000:3.0:1787548699.054053:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416106624 00000100:00100000:3.0:1787548699.054113:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:3.0:1787548699.054123:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:9681:x1874380416106624:12345-192.168.206.13@tcp:101:chmod.0 00010000:00010000:3.0:1787548699.054173:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548699.054196:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e91a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a21b1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.054261:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e921 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.054275:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.054287:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548699.054363:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787548699.054367:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548699.054413:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.054443:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e91a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21b1 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.054464:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e921 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21b1 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.054474:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:3.0:1787548699.054478:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787548699.054481:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec80031200, rc 0) 00000100:00100000:3.0:1787548699.054541:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:9681:x1874380416106624:12345-192.168.206.13@tcp:101:chmod.0 Request processed in 419us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548699.054548:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:1.0:1787548699.058538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548699.058619:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416106880 00000100:00100000:3.0:1787548699.058632:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416106880 00000100:00100000:3.0:1787548699.058695:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 17 00000100:00100000:3.0:1787548699.058706:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:9681:x1874380416106880:12345-192.168.206.13@tcp:36:chmod.0 00010000:00010000:3.0:1787548699.058772:0:8467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548699.058809:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e921 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21b1 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.058829:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:3.0:1787548699.058838:0:8467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787548699.058876:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e928 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.058899:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e928 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.058909:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e928 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787548699.059248:0:8467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028b714aa reply state 000000009238ef4d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e928 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548699.059258:0:8467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787548699.059271:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787548699.059349:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:9681:x1874380416106880:12345-192.168.206.13@tcp:36:chmod.0 Request processed in 645us (819us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787548699.059357:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 17 00010000:00010000:0.0:1787548699.061359:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e928 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.061374:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e928 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.061382:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e928 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.061401:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec80031600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548699.061406:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e928 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.061414:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e928 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.061431:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93400) 00010000:00010000:0.0:1787548699.061435:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787548699.061439:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e928 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.061445:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e928 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548699.076497:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548699.103298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548699.103566:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416107008 00000100:00100000:3.0:1787548699.103576:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416107008 00000100:00100000:3.0:1787548699.103636:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00100000:3.0:1787548699.103646:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:9682:x1874380416107008:12345-192.168.206.13@tcp:101:chown.0 00010000:00010000:3.0:1787548699.103669:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548699.103689:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e92f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a21b8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.103750:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e936 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.103763:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.103789:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548699.103845:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787548699.103849:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548699.103903:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.103929:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e92f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21b8 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.103948:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e936 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21b8 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.103956:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:3.0:1787548699.103959:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787548699.103962:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec80031e00, rc 0) 00000100:00100000:3.0:1787548699.104269:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:9682:x1874380416107008:12345-192.168.206.13@tcp:101:chown.0 Request processed in 623us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548699.104277:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00100000:1.0:1787548699.115231:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548699.115302:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416107136 00000100:00100000:3.0:1787548699.115312:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416107136 00000100:00100000:0.0:1787548699.115385:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 19 00000100:00100000:0.0:1787548699.115397:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:9682:x1874380416107136:12345-192.168.206.13@tcp:101:chown.0 00010000:00010000:0.0:1787548699.115417:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548699.115437:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424e93d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a21bf expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115498:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e944 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115512:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e944 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115523:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e944 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115554:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e94b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115561:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115567:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115658:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424e952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115665:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424e952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115672:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424e952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548699.115706:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787548699.115710:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548699.115732:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424e952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115742:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e944 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115748:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e944 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115754:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e944 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115768:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548699.115772:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e944 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115779:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e944 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115792:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:0.0:1787548699.115795:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548699.115799:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e944 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115804:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e944 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115816:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115821:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e94b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115827:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e94b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115831:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548699.115834:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e94b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115840:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e94b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115859:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8feca2cf6700) 00010000:00010000:0.0:1787548699.115861:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548699.115865:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e94b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115870:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e94b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115911:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424e93d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21bf expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115925:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424e952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21bf expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.115932:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8feca2cf6500) 00010000:00010000:0.0:1787548699.115934:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787548699.115937:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151400, rc 0) 00000100:00100000:0.0:1787548699.115994:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:9682:x1874380416107136:12345-192.168.206.13@tcp:101:chown.0 Request processed in 600us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548699.116002:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 19 00000100:00100000:1.0:1787548699.119599:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548699.119670:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416107392 00000100:00100000:3.0:1787548699.119679:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416107392 00000100:00100000:3.0:1787548699.119728:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00100000:3.0:1787548699.119737:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:9682:x1874380416107392:12345-192.168.206.13@tcp:36:chown.0 00010000:00010000:3.0:1787548699.119788:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548699.119811:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424e952 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21bf expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.119840:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8feca2cf6500) 00010000:00010000:3.0:1787548699.119849:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787548699.119870:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e959 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.119891:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.119901:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548699.139568:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431869312:0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.139634:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548699.139694:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787548699.139700:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431868928:0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.139742:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548699.139770:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431869440:0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.139795:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548699.139821:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431869056:0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.139844:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548699.139862:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431869568:0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.139896:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548699.139917:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787548699.139921:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431869184:0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.139941:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548699.139971:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431869312 00000100:00100000:1.0:1787548699.139977:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431869312 00000100:00100000:1.0:1787548699.140033:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431869568 00000100:00100000:1.0:1787548699.140048:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431869568 00000100:00100000:1.0:1787548699.140075:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787548699.140083:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431869312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.140162:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431869312:12345-0@lo:400:kworker.0 Request processed in 79us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548699.140168:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787548699.140184:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787548699.140190:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431869568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.140223:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431869568:12345-0@lo:400:kworker.0 Request processed in 33us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548699.140229:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787548699.140247:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431868928 00000100:00100000:1.0:1787548699.140250:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431868928 00000100:00100000:1.0:1787548699.140273:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787548699.140279:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431868928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.140309:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431868928:12345-0@lo:400:kworker.0 Request processed in 30us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548699.140315:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787548699.140340:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431869440 00000100:00100000:1.0:1787548699.140380:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431869440 00000100:00100000:1.0:1787548699.140401:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431869056 00000100:00100000:1.0:1787548699.140404:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431869056 00000100:00100000:1.0:1787548699.140413:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431869184 00000100:00100000:1.0:1787548699.140415:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431869184 00000100:00100000:1.0:1787548699.140428:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787548699.140434:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431869440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.140464:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431869440:12345-0@lo:400:kworker.0 Request processed in 30us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548699.140477:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787548699.140490:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787548699.140496:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431869056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.140523:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431869056:12345-0@lo:400:kworker.0 Request processed in 28us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548699.140529:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787548699.140540:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787548699.140545:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431869184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.140571:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431869184:12345-0@lo:400:kworker.0 Request processed in 26us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548699.140577:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1787548699.140596:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787548699.140600:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787548699.140602:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548699.140644:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431869696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548699.140682:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548699.140711:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431869696 00000100:00100000:1.0:1787548699.140714:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431869696 00000100:00100000:1.0:1787548699.140737:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787548699.140744:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431869696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787548699.140769:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548699.140802:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431869696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548699.140808:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787548699.140836:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecad71f800 x1874380431869696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548699.140865:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431869696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548699.140904:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431869184:0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.140914:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431869056:0@lo:400:kworker.0 00010000:00080000:1.0:1787548699.140923:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecad71e680 x1874380431869568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548699.140931:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431869568:0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.140961:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431868928:0@lo:400:kworker.0 00000100:00100000:1.0:1787548699.140969:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431869440:0@lo:400:kworker.0 00010000:00080000:1.0:1787548699.140979:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecad71d180 x1874380431869312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548699.140987:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431869312:0@lo:400:kworker.0 00000100:00100000:3.0:1787548699.141354:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787548699.142402:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431869824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548699.142458:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548699.142542:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431869824 00000100:00100000:1.0:1787548699.142549:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431869824 00000100:00100000:1.0:1787548699.142591:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787548699.142599:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431869824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787548699.142626:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548699.142674:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431869824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548699.142680:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787548699.142888:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feb81a86680 x1874380431869824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548699.142905:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431869824:0@lo:13:osp-pre-0-0.0 00000004:00010000:3.0:1787548699.172114:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2281900 reply state 000000001fd81f53 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548699.172148:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787548699.172322:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787548699.172427:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:9682:x1874380416107392:12345-192.168.206.13@tcp:36:chown.0 Request processed in 52686us (52831us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787548699.172436:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 20 00000001:00080000:0.0:1787548699.172827:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1787548699.173167:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.173179:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e959 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.173186:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e959 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.173199:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec80031200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548699.173203:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e959 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.173211:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e959 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.173233:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fec90d93100) 00010000:00010000:3.0:1787548699.173236:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787548699.173240:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e959 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.173246:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e959 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548699.207740:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548699.207949:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416107520 00000100:00100000:2.0:1787548699.207963:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416107520 00000100:00100000:2.0:1787548699.208074:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 21 00000100:00100000:2.0:1787548699.208087:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:9683:x1874380416107520:12345-192.168.206.13@tcp:101:touch.500 00010000:00010000:2.0:1787548699.208120:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548699.208520:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424e960 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a21c6 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787548699.225372:0:8467:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 16778us 00010000:00010000:1.0:1787548699.245050:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424e967 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245096:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424e967 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245114:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424e967 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245168:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e96e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245177:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245185:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245691:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424e975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245703:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424e975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245711:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424e975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548699.245782:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787548699.245785:0:8467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787548699.245890:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424e975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245905:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424e967 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245921:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424e967 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245928:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424e967 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245934:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fa00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548699.245938:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424e967 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245945:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424e967 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245958:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:1.0:1787548699.245960:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548699.245964:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424e967 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245970:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424e967 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245982:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245987:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e96e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245993:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e96e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.245997:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548699.246004:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e96e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.246009:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e96e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.246016:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8feca2d51100) 00010000:00010000:1.0:1787548699.246018:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548699.246020:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e96e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.246025:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e96e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.246068:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424e960 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21c6 expref: 8 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.246085:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424e975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21c6 expref: 7 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.246092:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8feca2d51d00) 00010000:00010000:1.0:1787548699.246094:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787548699.246096:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22e800, rc 0) 00000100:00100000:1.0:1787548699.246225:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:9683:x1874380416107520:12345-192.168.206.13@tcp:101:touch.500 Request processed in 38139us (38498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548699.246237:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 21 00000100:00100000:1.0:1787548699.250824:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548699.251303:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416107776 00000100:00100000:0.0:1787548699.251318:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416107776 00000100:00100000:0.0:1787548699.251401:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 22 00000100:00100000:0.0:1787548699.251432:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:9683:x1874380416107776:12345-192.168.206.13@tcp:101:touch.500 00010000:00010000:0.0:1787548699.251460:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548699.251485:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e97c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a21cd expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.251877:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e983 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.251906:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e983 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.251920:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e983 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.252499:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424e98a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.252523:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424e98a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.252537:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424e98a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787548699.256652:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787548699.256964:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424e991 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.256990:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424e991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.257004:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424e991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.257059:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e983 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.257067:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e983 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.257074:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e983 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.257081:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548699.257085:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e983 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.257092:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e983 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.257105:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8feca2d51d00) 00010000:00010000:0.0:1787548699.257109:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548699.257113:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e983 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.257120:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e983 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787548699.257170:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001af52e67 reply state 00000000b57a00c9 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424e98a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548699.257181:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787548699.257733:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e97c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21cd expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.257908:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424e991 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21cd expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.257917:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8feca2cf6c00) 00010000:00010000:0.0:1787548699.257920:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548699.257923:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150200, rc 0) 00000100:00100000:0.0:1787548699.258001:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:9683:x1874380416107776:12345-192.168.206.13@tcp:101:touch.500 Request processed in 6572us (7191us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787548699.258009:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 22 00010000:00010000:2.0:1787548699.259995:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424e98a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548699.260012:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424e98a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548699.260020:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424e98a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548699.260027:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548699.260041:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424e98a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548699.260050:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424e98a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548699.260070:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8b258fbb (ffff8feca2cf6700) 00010000:00010000:2.0:1787548699.260073:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548699.260077:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424e98a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548699.260083:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424e98a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548699.263643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548699.263861:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416108032 00000100:00100000:0.0:1787548699.263872:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416108032 00000100:00100000:0.0:1787548699.263932:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 23 00000100:00100000:0.0:1787548699.263942:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:9683:x1874380416108032:12345-192.168.206.13@tcp:36:touch.500 00010000:00010000:0.0:1787548699.263997:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548699.264025:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424e991 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21cd expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.264049:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8feca2cf6c00) 00010000:00010000:0.0:1787548699.264059:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787548699.264124:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e99f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.264171:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.264182:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787548699.264332:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0e6e538 reply state 0000000097a6119e transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548699.264342:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787548699.264865:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:9683:x1874380416108032:12345-192.168.206.13@tcp:36:touch.500 Request processed in 921us (1228us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787548699.264873:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 23 00010000:00010000:3.0:1787548699.267818:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.267837:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e99f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.267845:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e99f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.267851:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548699.267856:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e99f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.267863:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e99f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.267903:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8feca2cf6500) 00010000:00010000:3.0:1787548699.267906:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548699.267910:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e99f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.267917:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424e99f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548699.272975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548699.276631:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416108160 00000100:00100000:3.0:1787548699.276644:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416108160 00000100:00100000:3.0:1787548699.276759:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 24 00000100:00100000:3.0:1787548699.276770:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:9683:x1874380416108160:12345-192.168.206.13@tcp:101:touch.500 00010000:00010000:3.0:1787548699.276805:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548699.276825:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e9a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a21d4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.276897:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e9a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21d4 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.276914:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e9a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21d4 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.276934:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fec90d93100) 00010000:00010000:3.0:1787548699.276937:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787548699.276941:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec80031200, rc 0) 00000100:00100000:3.0:1787548699.277009:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:9683:x1874380416108160:12345-192.168.206.13@tcp:101:touch.500 Request processed in 242us (4043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548699.277016:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 24 00000100:00100000:0.0:1787548699.284752:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548699.284865:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416108288 00000100:00100000:1.0:1787548699.284897:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416108288 00000100:00100000:1.0:1787548699.284951:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:1.0:1787548699.284960:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1874380416108288:12345-192.168.206.13@tcp:8:touch.500 00010000:00080000:1.0:1787548699.284991:0:10297:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:1.0:1787548699.285017:0:10297:0:(genops.c:1385:class_connect()) connect: client e4505aba-b49a-4ae4-be2d-9f5ba513779c, cookie 0xcb7c48919424e9ad 00002000:00100000:1.0:1787548699.285029:0:10297:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e4505aba-b49a-4ae4-be2d-9f5ba513779c/ffff8fecb7dc3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787548699.285040:0:10297:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787548699.285303:0:10297:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787548699.285330:0:10297:0:(import.c:65:import_set_state_nolock()) ffff8fecb7dc7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787548699.285413:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2350:x1874380416108288:12345-192.168.206.13@tcp:8:touch.500 Request processed in 452us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548699.285421:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:2.0:1787548699.291038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548699.291210:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416108416 00000100:00100000:1.0:1787548699.291221:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416108416 00000100:00100000:1.0:1787548699.291332:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 17 00000100:00100000:1.0:1787548699.291341:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:0:x1874380416108416:12345-192.168.206.13@tcp:2:touch.500 00000100:00080000:2.0:1787548699.295031:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787548699.324515:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1787548699.324531:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000100:00100000:3.0:1787548699.324693:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:0:x1874380416108416:12345-192.168.206.13@tcp:2:touch.500 Request processed in 33347us (33658us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787548699.324704:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 17 00000100:00100000:2.0:1787548699.330245:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548699.333493:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416108672 00000100:00100000:3.0:1787548699.333509:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416108672 00000100:00100000:3.0:1787548699.333636:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 2 00000100:00100000:3.0:1787548699.333647:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:9683:x1874380416108672:12345-192.168.206.13@tcp:35:touch.500 00000100:00100000:3.0:1787548699.334010:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+11:9683:x1874380416108672:12345-192.168.206.13@tcp:35:touch.500 Request processed in 364us (3775us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787548699.334018:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 2 00000100:00100000:0.0:1787548699.347930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548699.348251:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416108800 00000100:00100000:1.0:1787548699.348261:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416108800 00000100:00100000:1.0:1787548699.348360:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 25 00000100:00100000:1.0:1787548699.348372:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+11:9684:x1874380416108800:12345-192.168.206.13@tcp:101:rm.0 00010000:00010000:1.0:1787548699.348397:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548699.348416:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424e9b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a21db expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.348622:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e9bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.348650:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e9bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.348661:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e9bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548699.348719:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787548699.348723:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787548699.348851:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e9bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.348889:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424e9b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21db expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.348906:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e9bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21db expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.348915:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8feca2d51d00) 00010000:00010000:1.0:1787548699.348918:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787548699.348921:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22f800, rc 0) 00000100:00100000:1.0:1787548699.349115:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:9684:x1874380416108800:12345-192.168.206.13@tcp:101:rm.0 Request processed in 744us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548699.349123:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 25 00000100:00100000:2.0:1787548699.352839:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548699.352993:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416109056 00000100:00100000:0.0:1787548699.353003:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416109056 00000100:00100000:0.0:1787548699.353067:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 26 00000100:00100000:0.0:1787548699.353077:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:9684:x1874380416109056:12345-192.168.206.13@tcp:101:rm.0 00010000:00010000:0.0:1787548699.353097:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548699.353115:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e9c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a21e2 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548699.353252:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787548699.353408:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e9c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21e2 expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.353422:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:0.0:1787548699.353425:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787548699.353431:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424e9c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21e2 expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.353581:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150600, rc 0) 00000100:00100000:0.0:1787548699.353635:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:9684:x1874380416109056:12345-192.168.206.13@tcp:101:rm.0 Request processed in 559us (804us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787548699.353642:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 26 00000100:00100000:2.0:1787548699.359487:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548699.359627:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416109184 00000100:00100000:0.0:1787548699.359637:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416109184 00000100:00100000:0.0:1787548699.359689:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 3 00000100:00100000:0.0:1787548699.359699:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:9684:x1874380416109184:12345-192.168.206.13@tcp:37:rm.0 00000100:00100000:3.0:1787548699.366394:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:9684:x1874380416109184:12345-192.168.206.13@tcp:37:rm.0 Request processed in 6687us (6906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548699.366406:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 3 00000100:00100000:2.0:1787548699.371253:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548699.371428:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416109440 00000100:00100000:3.0:1787548699.371438:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416109440 00000100:00100000:3.0:1787548699.371547:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 4 00000100:00100000:3.0:1787548699.371557:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca6f51050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:9684:x1874380416109440:12345-192.168.206.13@tcp:35:rm.0 00000100:00100000:3.0:1787548699.371808:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca6f51050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:9684:x1874380416109440:12345-192.168.206.13@tcp:35:rm.0 Request processed in 251us (561us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787548699.371816:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 4 00000100:00100000:2.0:1787548699.376471:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548699.376556:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416109696 00000100:00100000:3.0:1787548699.376565:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416109696 00000100:00100000:3.0:1787548699.376900:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 27 00000100:00100000:3.0:1787548699.376911:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:9684:x1874380416109696:12345-192.168.206.13@tcp:101:rm.0 00010000:00010000:3.0:1787548699.376934:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548699.376951:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031000/0xcb7c48919424e9d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a21e9 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.377082:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e9d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.377104:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e9d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.377116:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e9d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548699.377127:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787548699.377256:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031000/0xcb7c48919424e9d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21e9 expref: 17 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.377273:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e9d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21e9 expref: 16 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.377424:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8feca2d51d00) 00010000:00010000:3.0:1787548699.377427:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787548699.377431:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec80031600, rc 0) 00000100:00100000:2.0:1787548699.377601:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:9684:x1874380416109696:12345-192.168.206.13@tcp:101:rm.0 Request processed in 690us (1136us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787548699.377608:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 27 00000100:00100000:2.0:1787548699.381994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548699.382326:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416109824 00000100:00100000:0.0:1787548699.382336:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416109824 00000100:00100000:0.0:1787548699.382390:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 28 00000100:00100000:0.0:1787548699.382401:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:9684:x1874380416109824:12345-192.168.206.13@tcp:41:rm.0 00000004:00000024:0.0:1787548699.382455:0:5856:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787548699.382519:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:9684:x1874380416109824:12345-192.168.206.13@tcp:41:rm.0 Request processed in 119us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548699.382527:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 28 00000100:00100000:3.0:1787548699.384985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548699.385096:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416109952 00000100:00100000:1.0:1787548699.385105:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416109952 00000100:00100000:1.0:1787548699.385190:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 29 00000100:00100000:1.0:1787548699.385202:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:9684:x1874380416109952:12345-192.168.206.13@tcp:101:rm.0 00010000:00010000:1.0:1787548699.385221:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548699.385251:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424e9e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a21f0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385310:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424e9ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385324:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424e9ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385335:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424e9ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385349:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424e9f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385357:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424e9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385363:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424e9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385499:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fc00/0xcb7c48919424e9fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385508:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fc00/0xcb7c48919424e9fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385515:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fc00/0xcb7c48919424e9fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548699.385539:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787548699.385543:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787548699.385558:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fc00/0xcb7c48919424e9fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385574:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fc00/0xcb7c48919424e9fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385582:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424e9ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385587:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424e9ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385593:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424e9ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385598:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548699.385602:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424e9ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385609:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424e9ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385619:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8feca2d51d00) 00010000:00010000:1.0:1787548699.385622:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548699.385626:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424e9ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385632:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424e9ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385644:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424e9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385650:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424e9f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385662:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424e9f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385667:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548699.385670:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424e9f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385676:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424e9f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385684:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8b258fbb (ffff8feca2d51f00) 00010000:00010000:1.0:1787548699.385686:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548699.385689:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424e9f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385695:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424e9f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385724:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424e9e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21f0 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385738:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fc00/0xcb7c48919424e9fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21f0 expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.385745:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fec90d93100) 00010000:00010000:1.0:1787548699.385747:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787548699.385750:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22fc00, rc 0) 00000100:00100000:1.0:1787548699.385804:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:9684:x1874380416109952:12345-192.168.206.13@tcp:101:rm.0 Request processed in 604us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548699.385819:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 29 00000100:00100000:2.0:1787548699.389525:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548699.389614:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416110208 00000100:00100000:0.0:1787548699.389623:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416110208 00000100:00100000:0.0:1787548699.389676:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 30 00000100:00100000:0.0:1787548699.389687:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:9684:x1874380416110208:12345-192.168.206.13@tcp:36:rm.0 00010000:00010000:0.0:1787548699.389749:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787548699.389785:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fc00/0xcb7c48919424e9fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21f0 expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.389825:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031200/0xcb7c48919424e9a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21d4 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.389837:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fec90d93100) 00010000:00010000:0.0:1787548699.389851:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f800/0xcb7c48919424e9bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21db expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.389859:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8feca2d51d00) 00010000:00010000:0.0:1787548699.389862:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787548699.389890:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ea01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.389902:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ea01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.389911:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ea01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.389926:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ea08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.389933:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ea08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.389939:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ea08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.390055:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ea0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.390074:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ea0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.390081:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ea0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787548699.392870:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787548699.392896:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322269764761ns, next at 323269761409ns, rc = 0 00010000:00010000:0.0:1787548699.392962:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424ea16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.392976:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424ea16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.392986:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424ea16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.392994:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424ea16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393000:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424ea16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393006:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424ea16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393075:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787548699.393106:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ea0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393112:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ea0f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393127:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ea0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393156:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548699.393161:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ea0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393168:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ea0f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393180:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8feca2cf6300) 00010000:00010000:0.0:1787548699.393183:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787548699.393187:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ea0f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393193:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ea0f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393210:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ea01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393216:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ea01 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393222:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ea01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393227:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548699.393230:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ea01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393246:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ea01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393255:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8feca2d51d00) 00010000:00010000:0.0:1787548699.393257:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548699.393260:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ea01 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.393266:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ea01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787548699.393276:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007050a73b reply state 000000003c2cac20 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ea08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548699.393285:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787548699.393366:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:9684:x1874380416110208:12345-192.168.206.13@tcp:36:rm.0 Request processed in 3677us (3845us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787548699.393375:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 30 00010000:00010000:2.0:1787548699.395508:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ea08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548699.395524:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ea08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548699.395533:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ea08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548699.395539:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548699.395544:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ea08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548699.395551:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ea08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548699.395565:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8b258fbb (ffff8feca2cf6c00) 00010000:00010000:2.0:1787548699.395568:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548699.395572:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ea08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548699.395578:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ea08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.397877:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548699.397901:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424ea16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.397910:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150e00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548699.397915:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424ea16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.397923:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424ea16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.397939:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8feca2cf6300) 00010000:00010000:1.0:1787548699.397942:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787548699.397946:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424ea16 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.397952:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424ea16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.397970:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548699.397972:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548699.397974:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548699.399158:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548699.399240:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416110464 00000100:00100000:1.0:1787548699.399250:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416110464 00000100:00100000:1.0:1787548699.399297:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 5 00000100:00100000:1.0:1787548699.399307:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:9684:x1874380416110464:12345-192.168.206.13@tcp:35:rm.0 00000100:00100000:1.0:1787548699.399532:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:9684:x1874380416110464:12345-192.168.206.13@tcp:35:rm.0 Request processed in 226us (410us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787548699.399556:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 5 00000100:00100000:0.0:1787548699.403645:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548699.403741:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416110720 00000100:00100000:1.0:1787548699.403751:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416110720 00000100:00100000:1.0:1787548699.403815:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 31 00000100:00100000:1.0:1787548699.403825:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:9684:x1874380416110720:12345-192.168.206.13@tcp:36:rm.0 00010000:00010000:1.0:1787548699.403876:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787548699.403913:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031600/0xcb7c48919424e9d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21e9 expref: 16 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.403936:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424e975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21c6 expref: 15 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.403948:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8feca2d51d00) 00010000:00010000:1.0:1787548699.403961:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec80031e00/0xcb7c48919424e936 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21b8 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.403970:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:1.0:1787548699.403977:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787548699.403999:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ea1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.404012:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ea1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.404021:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ea1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.404032:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424ea24 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.404063:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424ea24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.404071:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424ea24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.404506:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424ea2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.404515:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424ea2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548699.404523:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424ea2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548699.406357:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787548699.406382:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424ea2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.406392:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424ea2b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.406400:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424ea2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.406405:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548699.406420:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424ea2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.406428:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424ea2b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.406442:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8feca2d51300) 00010000:00010000:0.0:1787548699.406445:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787548699.406448:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424ea2b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.406454:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f400/0xcb7c48919424ea2b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.406477:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ea1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.406484:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ea1d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.406489:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ea1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.406494:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fa00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548699.406497:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ea1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.406503:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ea1d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.406510:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2d51f00) 00010000:00010000:0.0:1787548699.406513:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548699.406523:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ea1d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548699.406529:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ea1d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787548699.406543:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000063fafd5 reply state 00000000f3784b62 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424ea24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548699.406552:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787548699.406693:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:9684:x1874380416110720:12345-192.168.206.13@tcp:36:rm.0 Request processed in 2866us (3053us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787548699.406702:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 31 00010000:00010000:3.0:1787548699.416916:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424ea24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.416933:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424ea24 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.416942:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424ea24 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.416966:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548699.416972:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424ea24 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.416980:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424ea24 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.416996:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8feca2d51100) 00010000:00010000:3.0:1787548699.416999:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548699.417003:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424ea24 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548699.417009:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e600/0xcb7c48919424ea24 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548700.101069:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548701.125786:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548702.150382:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548702.774029:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548702.774069:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548702.774098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548702.774155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548702.774184:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416110976 00000100:00100000:0.0:1787548702.774192:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416110976 00000100:00100000:0.0:1787548702.774242:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416111232 00000100:00100000:0.0:1787548702.774245:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416111232 00000100:00100000:0.0:1787548702.774268:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 91 00000100:00100000:0.0:1787548702.774277:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:2353:x1874380416110976:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548702.774346:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:2353:x1874380416110976:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 69us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548702.774354:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 91 00000100:00100000:1.0:1787548702.774484:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416111104 00000100:00100000:1.0:1787548702.774488:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416111104 00000100:00100000:1.0:1787548702.774523:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 46 00000100:00100000:1.0:1787548702.774531:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416111104:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548702.774560:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416111104:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 30us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548702.774567:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 46 00000100:00100000:2.0:1787548702.774654:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416110848 00000100:00100000:2.0:1787548702.774659:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416110848 00000100:00100000:2.0:1787548702.774687:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 243 00000100:00100000:2.0:1787548702.774694:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2353:x1874380416110848:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548702.774722:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2353:x1874380416110848:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 28us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548702.774729:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 243 00000100:00080000:2.0:1787548702.774754:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787548702.774758:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548702.774878:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 92 00000100:00100000:0.0:1787548702.774890:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2353:x1874380416111232:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548702.774932:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2353:x1874380416111232:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 45us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548702.788378:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 92 00010000:00010000:1.0:1787548703.172391:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787548703.779523:0:11619:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1787548704.196318:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548704.259638:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431869952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548704.259709:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548704.259829:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431869952 00000100:00100000:3.0:1787548704.259837:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431869952 00000100:00100000:3.0:1787548704.259905:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787548704.259915:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431869952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787548704.259947:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548704.259990:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431869952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548704.259998:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787548704.260064:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787548704.260093:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecad098000 x1874380431869952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548704.260110:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431869952:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1787548704.264872:0:8095:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 327141738977ns, next at 328141736195ns, rc = 0 00000100:00100000:1.0:1787548704.264978:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431870080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548704.265059:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548704.265124:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431870592:0@lo:400:kworker.0 00000100:00100000:1.0:1787548704.265195:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548704.265231:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787548704.265237:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431870208:0@lo:400:kworker.0 00000100:00100000:1.0:1787548704.265264:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548704.265286:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431870720:0@lo:400:kworker.0 00000100:00100000:1.0:1787548704.265325:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548704.265365:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431870336:0@lo:400:kworker.0 00000100:00100000:1.0:1787548704.265407:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548704.265438:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787548704.265444:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431870464:0@lo:400:kworker.0 00000100:00100000:1.0:1787548704.265475:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548704.265512:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431870080 00000100:00100000:1.0:1787548704.265520:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431870080 00000100:00100000:1.0:1787548704.265587:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787548704.265596:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431870080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787548704.265633:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548704.265683:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431870080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548704.265690:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787548704.265718:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431870592 00000100:00100000:1.0:1787548704.265723:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431870592 00000100:00100000:1.0:1787548704.265751:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431870336 00000100:00100000:1.0:1787548704.265754:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431870336 00000100:00100000:1.0:1787548704.265767:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431870464 00000100:00100000:1.0:1787548704.265769:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431870464 00000100:00100000:1.0:1787548704.265784:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787548704.265789:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431870592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548704.265831:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431870592:12345-0@lo:400:kworker.0 Request processed in 42us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548704.265838:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787548704.265851:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787548704.265870:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431870336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548704.265903:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431870336:12345-0@lo:400:kworker.0 Request processed in 46us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548704.265909:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787548704.265919:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787548704.265925:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431870464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548704.265949:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431870464:12345-0@lo:400:kworker.0 Request processed in 25us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548704.265953:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787548704.265968:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431870208 00000100:00100000:1.0:1787548704.265971:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431870208 00000100:00100000:1.0:1787548704.266558:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787548704.266567:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431870208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548704.266610:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431870208:12345-0@lo:400:kworker.0 Request processed in 45us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548704.266616:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787548704.266653:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431870720 00000100:00100000:1.0:1787548704.266663:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431870720 00000100:00100000:1.0:1787548704.266695:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787548704.266701:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431870720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548704.266728:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431870720:12345-0@lo:400:kworker.0 Request processed in 27us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548704.266742:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787548704.266765:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787548704.266769:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787548704.266814:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431870464:0@lo:400:kworker.0 00000100:00100000:1.0:1787548704.266825:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431870336:0@lo:400:kworker.0 00000100:00100000:1.0:1787548704.266873:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431870208:0@lo:400:kworker.0 00010000:00080000:1.0:1787548704.266886:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecbd0f2300 x1874380431870720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548704.266896:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431870720:0@lo:400:kworker.0 00010000:00080000:1.0:1787548704.266905:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecbd0f3480 x1874380431870080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548704.266920:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431870080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548704.266931:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431870592:0@lo:400:kworker.0 00000001:00080000:2.0:1787548704.337165:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1787548704.337185:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787548704.337223:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1787548704.337332:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787548704.337354:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431870848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787548704.337440:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548704.337499:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431870848 00000100:00100000:2.0:1787548704.337513:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431870848 00000100:00100000:2.0:1787548704.337582:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787548704.337595:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431870848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787548704.337636:0:10297:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787548704.337690:0:10297:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8bd41c, atime: 0x6a8bd41c, ctime: 0x6a8bd41c, blocks: 0x1 00010000:00010000:2.0:1787548704.337700:0:10297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424ea32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.337721:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:2.0:1787548704.337726:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548704.337733:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424ea32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.337842:0:10297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424ea32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.337865:0:10297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424ea32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.337875:0:10297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424ea32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.337971:0:10297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787548704.339190:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1874380431870848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1592us (1743us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787548704.339206:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787548704.339567:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548704.339578:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424ea32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.339591:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ed200 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548704.339597:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424ea32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.339626:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424ea32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.339653:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424ea32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.339662:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424ea32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.339692:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548704.339694:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548704.339696:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787548704.344712:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fecbd0f2d80/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787548704.344727:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431870848:0@lo:6:osp-syn-1-0.0 00000020:00000080:0.0:1787548704.758933:0:11668:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4f9bb550 20000000:00000080:0.0:1787548704.758950:0:11668:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fec905cb400 uarg=0000000000000000 20000000:01000000:0.0:1787548704.758983:0:11668:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787548704.758989:0:11668:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787548704.758994:0:11668:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787548704.760080:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787548704.760661:0:11668:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787548704.766121:0:11668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787548704.770384:0:11668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787548704.770480:0:11668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787548704.770501:0:11668:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787548704.770521:0:11668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.770539:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e8db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e8d4 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.770546:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fecbd22ea00/0xcb7c48919424e8e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e8e2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.770553:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e8f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424e8f0 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.770574:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fecc21edc00/0xcb7c48919424e8fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21a3 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.770581:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec80031800/0xcb7c48919424e905 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21aa expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.770587:0:11668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.770626:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec80031800/0xcb7c48919424e905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21aa expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.770641:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fec80031800/0xcb7c48919424e905 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21aa expref: 12 pid: 5848 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548704.770655:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad098a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874380431870976:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548704.770806:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fecc21edc00/0xcb7c48919424e8fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21a3 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.770816:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fecc21edc00/0xcb7c48919424e8fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21a3 expref: 12 pid: 5848 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548704.770824:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad098000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874380431871104:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548704.770871:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e8f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e8f0 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.770881:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e8f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e8f0 expref: 18 pid: 5849 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548704.770903:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874380431871232:0@lo:104: 00000100:00100000:2.0:1787548704.770944:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787548704.770988:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fecbd22ea00/0xcb7c48919424e8e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e8e2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.770997:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fecbd22ea00/0xcb7c48919424e8e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e8e2 expref: 18 pid: 5846 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548704.771227:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874380431871360:0@lo:104: 00000100:00100000:2.0:1787548704.771251:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787548704.771277:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e8db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424e8d4 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548704.771285:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e8db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424e8d4 expref: 18 pid: 5846 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548704.771293:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874380431871488:0@lo:104: 00000100:00100000:2.0:1787548704.771316:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548704.771327:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d2e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787548704.771438:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787548704.771452:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431871232 00000100:00100000:1.0:1787548704.771459:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431871232 00000100:00100000:1.0:1787548704.771491:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431871360 00000100:00100000:1.0:1787548704.771494:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431871360 00000100:00100000:1.0:1787548704.771504:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431871488 00000100:00100000:1.0:1787548704.771506:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431871488 00000100:00100000:1.0:1787548704.771519:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787548704.771527:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+5:11668:x1874380431871232:12345-0@lo:104: 00010000:00010000:1.0:1787548704.771539:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e8f7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771591:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787548704.771597:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+5:11668:x1874380431871232:12345-0@lo:104: Request processed in 72us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548704.771617:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787548704.771633:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787548704.771638:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+4:11668:x1874380431871360:12345-0@lo:104: 00010000:00010000:1.0:1787548704.771645:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e8e9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771673:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787548704.771677:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+4:11668:x1874380431871360:12345-0@lo:104: Request processed in 40us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548704.771682:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787548704.771691:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787548704.771696:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7d5d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:11668:x1874380431871488:12345-0@lo:104: 00010000:00010000:1.0:1787548704.771702:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e8db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771725:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787548704.771730:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7d5d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+3:11668:x1874380431871488:12345-0@lo:104: Request processed in 34us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548704.771735:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787548704.771767:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787548704.771772:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e8f7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771779:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec80031a00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:1.0:1787548704.771783:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e8f7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771805:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e8f7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548704.771812:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e8f7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548704.771819:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787548704.771844:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e8f7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771849:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548704.771876:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e8f7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771883:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec80031a00/0xcb7c48919424e8f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e8f7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771895:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787548704.771899:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e8e9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771905:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec80030a00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:1.0:1787548704.771907:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e8e9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771912:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e8e9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548704.771919:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e8e9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548704.771929:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787548704.771945:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e8e9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771950:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548704.771963:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e8e9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771968:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec80030a00/0xcb7c48919424e8e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e8e9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771978:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548704.771981:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424e8db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771986:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150000 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:1.0:1787548704.771988:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424e8db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.771993:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424e8db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548704.771998:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424e8db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548704.772016:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787548704.772029:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e8db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.772034:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548704.772048:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e8db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.772054:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec90150000/0xcb7c48919424e8d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424e8db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.772066:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548704.772068:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548704.772070:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548704.772078:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548704.772083:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548704.772103:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431871616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787548704.772148:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548704.772178:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431871744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787548704.772196:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548704.772208:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787548704.772212:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431871872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787548704.772229:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548704.772249:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431871616 00000100:00100000:1.0:1787548704.772252:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431871616 00010000:00010000:1.0:1787548704.772267:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e8f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e8f0 expref: 19 pid: 5849 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548704.772284:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431871744 00000100:00100000:1.0:1787548704.772286:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431871744 00010000:00010000:1.0:1787548704.772294:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fecbd22ea00/0xcb7c48919424e8e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e8e2 expref: 20 pid: 5846 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548704.772303:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431871872 00000100:00100000:1.0:1787548704.772306:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431871872 00010000:00010000:1.0:1787548704.772329:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e8db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e8d4 expref: 21 pid: 5846 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548704.772341:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787548704.772348:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+21:3316:x1874380431871616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787548704.772356:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548704.772360:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e8f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e8f0 expref: 21 pid: 5849 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.772369:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e8f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e8f0 expref: 21 pid: 5849 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.772383:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548704.772408:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+21:3316:x1874380431871616:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548704.772414:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787548704.772428:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787548704.772433:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+20:3313:x1874380431871744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787548704.772439:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548704.772444:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fecbd22ea00/0xcb7c48919424e8e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e8e2 expref: 20 pid: 5846 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.772452:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fecbd22ea00/0xcb7c48919424e8e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e8e2 expref: 20 pid: 5846 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.772461:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548704.772498:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+20:3313:x1874380431871744:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548704.772504:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787548704.772523:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787548704.772529:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431871872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787548704.772536:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548704.772540:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e8db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424e8d4 expref: 19 pid: 5846 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.772548:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e8db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424e8d4 expref: 19 pid: 5846 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.772558:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548704.772579:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431871872:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548704.772585:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787548704.772637:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431871616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787548704.772928:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431871872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787548704.772948:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431871744:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787548704.773095:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21ec200/0xcb7c48919424e8f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e8f0 expref: 18 pid: 5849 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548704.773108:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874380431871232:0@lo:104: 00010000:00010000:2.0:1787548704.773118:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecbd22ea00/0xcb7c48919424e8e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e8e2 expref: 17 pid: 5846 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548704.773125:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874380431871360:0@lo:104: 00010000:00010000:2.0:1787548704.773177:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424e8db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424e8d4 expref: 16 pid: 5846 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548704.773196:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874380431871488:0@lo:104: 00000100:00100000:1.0:1787548704.778987:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad098a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874380431870976:192.168.206.13@tcp:104: 00000100:00100000:1.0:1787548704.779001:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad098000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874380431871104:192.168.206.13@tcp:104: 00010000:00010000:1.0:1787548704.779048:0:11668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548704.780288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548704.780321:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548704.780346:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416111360 00000100:00100000:1.0:1787548704.780352:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416111360 00010000:00010000:1.0:1787548704.780384:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec80031800/0xcb7c48919424e905 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21aa expref: 13 pid: 5848 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548704.780411:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416111488 00000100:00100000:1.0:1787548704.780414:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416111488 00010000:00010000:1.0:1787548704.780438:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fecc21edc00/0xcb7c48919424e8fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21a3 expref: 14 pid: 5848 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548704.780460:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 33 00000100:00100000:1.0:1787548704.780468:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:450a7108-39f6-4004-8f60-5d2336e0cad2+14:2351:x1874380416111360:12345-192.168.206.13@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787548704.780556:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 34 00000100:00100000:3.0:1787548704.780567:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:450a7108-39f6-4004-8f60-5d2336e0cad2+14:2352:x1874380416111488:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548704.780577:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548704.780584:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fecc21edc00/0xcb7c48919424e8fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21a3 expref: 14 pid: 5848 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548704.780597:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fecc21edc00/0xcb7c48919424e8fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21a3 expref: 14 pid: 5848 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548704.780613:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21edc00/0xcb7c48919424e8fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21a3 expref: 14 pid: 5848 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548704.780628:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548704.780674:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2352:x1874380416111488:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 108us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548704.780681:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 34 00010000:00010000:1.0:1787548704.780772:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548704.780778:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec80031800/0xcb7c48919424e905 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21aa expref: 12 pid: 5848 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.780787:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec80031800/0xcb7c48919424e905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21aa expref: 12 pid: 5848 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.780798:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec80031800/0xcb7c48919424e905 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21aa expref: 12 pid: 5848 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.780809:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.780817:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.780832:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.780839:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.780845:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.780863:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.780877:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ed200 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548704.780882:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.780890:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.780914:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548704.780925:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548704.780951:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:450a7108-39f6-4004-8f60-5d2336e0cad2+11:2351:x1874380416111360:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 484us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548704.780959:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 33 00010000:00010000:3.0:1787548704.781020:0:11668:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548704.781029:0:11668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548704.781037:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21ed200/0xcb7c48919424ea39 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787548704.861783:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1787548705.219768:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787548705.987265:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787548705.987274:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fec88445800 from 7 10000000:01000000:1.0:1787548705.987278:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787548705.987324:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548705.987336:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548705.987348:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548705.987371:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431872000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787548705.987427:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548705.987501:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd35840 going to sleep for 11 seconds 00000100:00100000:2.0:1787548705.987635:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431872000 00000100:00100000:2.0:1787548705.987643:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431872000 00000100:00100000:2.0:1787548705.987687:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787548705.987695:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+16:5851:x1874380431872000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548705.987707:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548705.987728:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424ea47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424ea40 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548705.987749:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424ea47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424ea40 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548705.987764:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424ea47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424ea40 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548705.987773:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ed000, rc 0) 00000100:00100000:2.0:1787548705.987810:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431872000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548705.987817:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787548705.989428:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431872000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787548705.989465:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424ea47 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548705.989478:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424ea47 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548705.989549:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431872128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548705.989596:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548705.989638:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787548705.990086:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431872128 00000100:00100000:1.0:1787548705.990092:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431872128 00000100:00100000:1.0:1787548705.990169:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787548705.990178:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431872128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787548705.990428:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431872128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548705.990436:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787548705.990588:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431872128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548705.990625:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431872256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787548705.990666:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548705.990694:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787548705.990782:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431872256 00000100:00100000:1.0:1787548705.990787:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431872256 00000100:00100000:1.0:1787548705.990824:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787548705.990832:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431872256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548705.991200:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431872256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 368us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548705.991207:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787548705.993346:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431872256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787548705.993959:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:11684:1874380431872384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787548705.994023:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548705.994071:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec87ca8180 going to sleep for 11 seconds 00000100:00100000:2.0:1787548705.994257:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431872384 00000100:00100000:2.0:1787548705.994265:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431872384 00000100:00100000:2.0:1787548705.994312:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787548705.994322:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:11684:x1874380431872384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787548705.994538:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:11684:x1874380431872384:12345-0@lo:502:llog_process_th.0 Request processed in 216us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548705.994554:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787548705.994683:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:11684:1874380431872384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787548705.994707:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787548705.994717:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548705.994720:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787548705.994732:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fec88445800 00000020:00000080:0.0:1787548705.994735:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787548705.994808:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:11684:1874380431872512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787548705.994843:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548705.994885:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec87ca8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787548705.995493:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431872512 00000100:00100000:1.0:1787548705.995500:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431872512 00000100:00100000:1.0:1787548705.995545:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787548705.995555:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+17:11684:x1874380431872512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548705.995718:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+17:11684:x1874380431872512:12345-0@lo:502:llog_process_th.0 Request processed in 165us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548705.995726:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787548705.995868:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:11684:1874380431872512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787548705.995887:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787548705.995892:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548705.995894:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787548705.995898:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787548705.996043:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787548705.996062:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787548705.996072:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424ea47 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548705.996083:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424ea47 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548705.996106:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787548705.996114:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fecad08a800 from 7 10000000:01000000:3.0:1787548705.996117:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787548705.996178:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548705.996186:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548705.996201:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548705.996215:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431872640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787548705.996247:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548705.996277:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787548705.996465:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431872640 00000100:00100000:1.0:1787548705.996470:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431872640 00000100:00100000:1.0:1787548705.996504:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787548705.996512:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+17:5851:x1874380431872640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787548705.996521:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548705.996537:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbd22f800/0xcb7c48919424ea55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424ea4e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548705.996557:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbd22f800/0xcb7c48919424ea55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424ea4e expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548705.996568:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbd22f800/0xcb7c48919424ea55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424ea4e expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548705.996577:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22f800, rc 0) 00000100:00100000:1.0:1787548705.996619:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431872640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548705.996626:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787548705.996697:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431872640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787548705.996709:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424ea55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548705.996719:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424ea55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548705.996764:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431872768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787548705.996790:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548705.996818:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec87ca8180 going to sleep for 11 seconds 00000100:00100000:3.0:1787548705.998284:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431872768 00000100:00100000:3.0:1787548705.998293:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431872768 00000100:00100000:3.0:1787548705.998343:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787548705.998352:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431872768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548705.998583:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431872768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548705.998590:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787548705.998671:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431872768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787548705.998711:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431872896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787548705.998750:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548705.998784:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec87ca8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787548705.998898:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431872896 00000100:00100000:1.0:1787548705.998903:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431872896 00000100:00100000:1.0:1787548705.998936:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787548705.998944:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431872896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548705.999083:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431872896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548705.999103:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787548705.999314:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431872896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787548706.000873:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:11685:1874380431873024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787548706.000934:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548706.000976:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec87ca8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548706.001067:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431873024 00000100:00100000:2.0:1787548706.001074:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431873024 00000100:00100000:2.0:1787548706.001149:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787548706.001158:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec865da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:11685:x1874380431873024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787548706.001659:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec865da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:11685:x1874380431873024:12345-0@lo:502:llog_process_th.0 Request processed in 500us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548706.001668:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787548706.001736:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:11685:1874380431873024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787548706.001761:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548706.001770:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548706.001772:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787548706.001779:0:11685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fecad08a800 00000020:00000080:1.0:1787548706.001782:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787548706.001909:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:11685:1874380431873152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548706.001946:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548706.001985:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd35600 going to sleep for 11 seconds 00000100:00100000:0.0:1787548706.003574:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431873152 00000100:00100000:0.0:1787548706.003583:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431873152 00000100:00100000:0.0:1787548706.003621:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787548706.003629:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec900bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+18:11685:x1874380431873152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787548706.003862:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec900bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+18:11685:x1874380431873152:12345-0@lo:502:llog_process_th.0 Request processed in 233us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548706.003870:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787548706.011667:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:11685:1874380431873152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787548706.011709:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548706.011717:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548706.011720:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787548706.011724:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787548706.011792:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787548706.011809:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787548706.011819:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424ea55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548706.011830:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424ea55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548706.011839:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787548706.011842:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fec8644c800 from 7 10000000:01000000:1.0:1787548706.011844:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787548706.011884:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548706.011893:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548706.011903:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548706.011923:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431873280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787548706.011979:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548706.012022:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd35600 going to sleep for 11 seconds 00000100:00100000:3.0:1787548706.012153:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431873280 00000100:00100000:3.0:1787548706.012160:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431873280 00000100:00100000:3.0:1787548706.012201:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787548706.012211:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec900bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:5851:x1874380431873280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787548706.012223:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548706.012235:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbcc93000/0xcb7c48919424ea63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424ea5c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548706.012254:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbcc93000/0xcb7c48919424ea63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424ea5c expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548706.012263:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbcc93000/0xcb7c48919424ea63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424ea5c expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548706.012281:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93000, rc 0) 00000100:00100000:3.0:1787548706.012321:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec900bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431873280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548706.012328:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787548706.012361:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431873280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787548706.012373:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548706.012382:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548706.012425:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431873408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548706.012450:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548706.012461:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb8600 going to sleep for 11 seconds 00000100:00100000:1.0:1787548706.014226:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431873408 00000100:00100000:1.0:1787548706.014249:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431873408 00000100:00100000:1.0:1787548706.014298:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787548706.014306:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431873408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787548706.014562:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431873408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548706.014570:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787548706.014640:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431873408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787548706.014680:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431873536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787548706.014720:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548706.015168:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb8600 going to sleep for 11 seconds 00000100:00100000:1.0:1787548706.015293:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431873536 00000100:00100000:1.0:1787548706.015299:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431873536 00000100:00100000:1.0:1787548706.015354:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787548706.015361:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431873536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548706.015516:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:5851:x1874380431873536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548706.015523:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787548706.015568:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90bd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3418829f-2e19-44b5-ae62-1256ac42dc62:5851:1874380431873536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548706.015735:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:11688:1874380431873664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548706.015772:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548706.015794:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431873664 00000100:00100000:1.0:1787548706.015798:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431873664 00000100:00100000:1.0:1787548706.015819:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787548706.015825:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:11688:x1874380431873664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548706.015961:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:11688:x1874380431873664:12345-0@lo:502:llog_process_th.0 Request processed in 136us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548706.015968:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787548706.015998:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd35840 going to sleep for 11 seconds 00000100:00100000:1.0:1787548706.016010:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:11688:1874380431873664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787548706.016039:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548706.016047:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548706.016049:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787548706.016057:0:11688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fec8644c800 00000020:00000080:1.0:1787548706.016059:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787548706.017048:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:11688:1874380431873792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548706.019470:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548706.019526:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431873792 00000100:00100000:1.0:1787548706.019533:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431873792 00000100:00100000:1.0:1787548706.019578:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787548706.019587:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:11688:x1874380431873792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548706.019808:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:11688:x1874380431873792:12345-0@lo:502:llog_process_th.0 Request processed in 222us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548706.019816:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787548706.019869:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd35840 going to sleep for 11 seconds 00000100:00100000:1.0:1787548706.019889:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3418829f-2e19-44b5-ae62-1256ac42dc62:11688:1874380431873792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787548706.019917:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548706.019925:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548706.019927:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787548706.019933:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787548706.020027:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787548706.020045:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787548706.020054:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548706.020074:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787548706.038060:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787548706.103254:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548706.103421:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416111616 00000100:00100000:3.0:1787548706.103431:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416111616 00000100:00100000:3.0:1787548706.103483:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 260 00000100:00100000:3.0:1787548706.103493:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+11:5595:x1874380416111616:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787548706.103509:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548706.103524:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424ea6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a21f7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548706.103552:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424ea6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21f7 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548706.103563:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424ea6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21f7 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548706.103572:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93c00, rc 0) 00000100:00100000:3.0:1787548706.103631:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+12:5595:x1874380416111616:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 Request processed in 139us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548706.103639:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 260 00000100:00100000:0.0:1787548706.106961:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548706.107052:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416111744 00000100:00100000:1.0:1787548706.107062:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416111744 00000100:00100000:1.0:1787548706.107113:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 261 00000100:00100000:1.0:1787548706.107123:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+12:5595:x1874380416111744:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548706.107721:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+12:5595:x1874380416111744:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 Request processed in 596us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548706.107731:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 261 00000100:00100000:0.0:1787548706.112374:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548706.114403:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416111872 00000100:00100000:1.0:1787548706.114416:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416111872 00000100:00100000:0.0:1787548706.121466:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 262 00000100:00100000:0.0:1787548706.121481:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+12:5595:x1874380416111872:12345-192.168.206.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787548706.122860:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+12:5595:x1874380416111872:12345-192.168.206.13@tcp:503:ll_cfg_requeue.0 Request processed in 1367us (10478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548706.122872:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 262 00000100:00100000:2.0:1787548706.135368:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548706.135474:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416112000 00000100:00100000:1.0:1787548706.135502:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416112000 00000100:00100000:1.0:1787548706.135564:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 263 00000100:00100000:1.0:1787548706.135581:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+12:9954:x1874380416112000:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787548706.135807:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+12:9954:x1874380416112000:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 235us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548706.135816:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 263 00000100:00100000:1.0:1787548706.145942:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548706.146037:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416112128 00000100:00100000:0.0:1787548706.146047:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416112128 00000100:00100000:0.0:1787548706.146103:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 264 00000100:00100000:0.0:1787548706.146113:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+12:9954:x1874380416112128:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787548706.149053:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+12:9954:x1874380416112128:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 2933us (3111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548706.149068:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 264 00000100:00100000:0.0:1787548706.162804:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548706.163083:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416112256 00000100:00100000:3.0:1787548706.163101:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416112256 00000100:00100000:1.0:1787548706.163334:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 265 00000100:00100000:1.0:1787548706.163353:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+12:5595:x1874380416112256:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787548706.163370:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548706.163387:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbd22e600/0xcb7c48919424ea71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a21fe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548706.163414:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbd22e600/0xcb7c48919424ea71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21fe expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548706.163425:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbd22e600/0xcb7c48919424ea71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21fe expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548706.163433:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22e600, rc 0) 00000100:00100000:1.0:1787548706.163500:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:5595:x1874380416112256:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 Request processed in 154us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548706.163507:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 265 00000100:00100000:0.0:1787548706.169431:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548706.169691:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416112384 00000100:00100000:2.0:1787548706.169703:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416112384 00000100:00100000:2.0:1787548706.169884:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 266 00000100:00100000:2.0:1787548706.169898:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:5595:x1874380416112384:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548706.170345:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:5595:x1874380416112384:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 Request processed in 448us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548706.170355:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 266 00000100:00100000:0.0:1787548706.173305:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548706.173485:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416112512 00000100:00100000:1.0:1787548706.173498:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416112512 00000100:00100000:1.0:1787548706.173569:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 267 00000100:00100000:1.0:1787548706.173584:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:5595:x1874380416112512:12345-192.168.206.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787548706.173879:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:5595:x1874380416112512:12345-192.168.206.13@tcp:503:ll_cfg_requeue.0 Request processed in 297us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548706.173888:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 267 00000100:00100000:0.0:1787548706.179088:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548706.179355:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416112640 00000100:00100000:2.0:1787548706.179369:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416112640 00000100:00100000:2.0:1787548706.179460:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 268 00000100:00100000:2.0:1787548706.179471:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:9957:x1874380416112640:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787548706.179883:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:9957:x1874380416112640:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 412us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548706.179892:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 268 00000100:00100000:0.0:1787548706.183993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548706.184226:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416112768 00000100:00100000:3.0:1787548706.184238:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416112768 00000100:00100000:3.0:1787548706.184301:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 269 00000100:00100000:3.0:1787548706.184312:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:9957:x1874380416112768:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787548706.184630:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:9957:x1874380416112768:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 312us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548706.184647:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 269 00010000:00010000:1.0:1787548706.243733:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787548707.078612:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787548707.267696:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548707.896230:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548707.896277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548707.896314:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548707.896353:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548707.896387:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416113024 00000100:00100000:0.0:1787548707.896396:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416113024 00000100:00100000:0.0:1787548707.896452:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416113280 00000100:00100000:0.0:1787548707.896455:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416113280 00000100:00100000:0.0:1787548707.896479:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 96 00000100:00100000:0.0:1787548707.896489:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416113024:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548707.896559:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416113024:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 71us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548707.896566:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 96 00000100:00100000:0.0:1787548707.896582:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 97 00000100:00100000:0.0:1787548707.896589:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92088e20-066b-499e-ac52-ab10992c506a+5:2353:x1874380416113280:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548707.896614:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92088e20-066b-499e-ac52-ab10992c506a+5:2353:x1874380416113280:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548707.896621:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 97 00000100:00080000:0.0:1787548707.896636:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548707.897016:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416113152 00000100:00100000:3.0:1787548707.897023:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416113152 00000100:00100000:3.0:1787548707.897078:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 48 00000100:00100000:3.0:1787548707.897087:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416113152:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548707.897128:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416113152:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 43us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548707.897160:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 48 00000100:00080000:0.0:1787548707.897482:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787548707.898272:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416112896 00000100:00100000:1.0:1787548707.898281:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416112896 00000100:00100000:1.0:1787548707.898333:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 270 00000100:00100000:1.0:1787548707.898343:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2353:x1874380416112896:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548707.898407:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2353:x1874380416112896:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 65us (2186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548707.898414:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 270 00010000:00010000:1.0:1787548708.294055:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548709.316721:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548709.379741:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431873920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548709.379807:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548709.380043:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431873920 00000100:00100000:2.0:1787548709.380052:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431873920 00000100:00100000:2.0:1787548709.380116:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787548709.380126:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431873920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787548709.380180:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548709.380226:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431873920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548709.380234:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787548709.380303:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787548709.380333:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca2f3df80 x1874380431873920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548709.380352:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431873920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548709.383929:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431874048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548709.384003:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548709.384112:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431874176:0@lo:400:kworker.0 00000100:00100000:1.0:1787548709.384160:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548709.384183:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787548709.384190:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431874304:0@lo:400:kworker.0 00000100:00100000:1.0:1787548709.384217:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548709.384256:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431874560:0@lo:400:kworker.0 00000100:00100000:1.0:1787548709.384279:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548709.385107:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431874048 00000100:00100000:3.0:1787548709.385117:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431874048 00000100:00100000:3.0:1787548709.385198:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787548709.385208:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431874048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787548709.385238:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548709.385290:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431874048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548709.386208:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431874432:0@lo:400:kworker.0 00000100:00100000:2.0:1787548709.386258:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548709.386315:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431874304 00000100:00100000:2.0:1787548709.386321:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431874304 00000100:00100000:2.0:1787548709.386353:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431874560 00000100:00100000:2.0:1787548709.386356:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431874560 00000100:00100000:3.0:1787548709.386467:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787548709.386492:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787548709.386511:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431874432 00000100:00100000:3.0:1787548709.386525:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431874432 00000100:00100000:3.0:1787548709.386555:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787548709.386563:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431874304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548709.387262:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787548709.387274:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431874432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548709.387341:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431874432:12345-0@lo:400:kworker.0 Request processed in 70us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548709.387348:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787548709.387532:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431874304:0@lo:400:kworker.0 00000100:00100000:3.0:1787548709.387985:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431874304:12345-0@lo:400:kworker.0 Request processed in 1420us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548709.387993:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1787548709.388017:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548709.388050:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431874432:0@lo:400:kworker.0 00000100:00100000:3.0:1787548709.388083:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431874176 00000100:00100000:3.0:1787548709.388089:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431874176 00000100:00100000:3.0:1787548709.388126:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787548709.388154:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431874176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548709.388202:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431874176:12345-0@lo:400:kworker.0 Request processed in 50us (4041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548709.388208:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787548709.388248:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431874176:0@lo:400:kworker.0 00000100:00100000:2.0:1787548709.389497:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787548709.389512:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431874560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548709.389578:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431874560:12345-0@lo:400:kworker.0 Request processed in 71us (5298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548709.389584:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1787548709.389620:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787548709.389763:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787548709.389781:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fecbd0f2d80, transno 4294967300 00000100:00100000:1.0:1787548709.389800:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431874048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548709.389839:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431874560:0@lo:400:kworker.0 00000004:00080000:2.0:1787548709.462359:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:1.0:1787548710.342550:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548711.363497:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548712.387571:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548713.015919:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548713.015986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548713.016019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548713.016042:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548713.016173:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416113664 00000100:00100000:3.0:1787548713.016175:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416113408 00000100:00100000:3.0:1787548713.016185:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416113408 00000100:00100000:2.0:1787548713.016186:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416113664 00000100:00100000:3.0:1787548713.016237:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 272 00000100:00100000:2.0:1787548713.016242:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 49 00000100:00100000:3.0:1787548713.016250:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2353:x1874380416113408:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548713.016257:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416113664:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548713.016321:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416113664:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 70us (333us total) trans 0 rc 0/0 00000100:00080000:0.0:1787548713.016329:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787548713.016331:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 49 00000100:00100000:2.0:1787548713.016371:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416113536 00000100:00100000:2.0:1787548713.016375:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416113536 00000100:00100000:2.0:1787548713.016406:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416113792 00000100:00100000:2.0:1787548713.016409:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416113792 00000100:00100000:2.0:1787548713.016432:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 101 00000100:00100000:2.0:1787548713.016440:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416113536:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548713.016507:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 102 00000100:00100000:1.0:1787548713.016517:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2353:x1874380416113792:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548713.020378:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2353:x1874380416113408:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 4122us (4458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548713.020393:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 272 00000100:00080000:3.0:1787548713.020472:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548713.023528:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416113536:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 7075us (7495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548713.023545:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 101 00000100:00100000:1.0:1787548713.031275:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2353:x1874380416113792:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 14748us (15219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548713.031290:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 102 00010000:00010000:1.0:1787548713.411322:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548714.435276:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548714.499395:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787548714.499415:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431874688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787548714.499480:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548714.499595:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431874688 00000100:00100000:1.0:1787548714.499603:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431874688 00000100:00100000:1.0:1787548714.499665:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787548714.499675:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431874688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787548714.499705:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548714.499743:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431874688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548714.499749:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1787548714.499813:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787548714.499847:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431874688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787548714.500654:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431874816:0@lo:400:kworker.0 00000100:00100000:2.0:1787548714.500697:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548714.500734:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874380431875328:0@lo:400:kworker.0 00000100:00100000:2.0:1787548714.500759:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548714.500777:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787548714.500782:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431875200:0@lo:400:kworker.0 00000100:00100000:2.0:1787548714.500832:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548714.501091:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431874944:0@lo:400:kworker.0 00000100:00100000:3.0:1787548714.501228:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548714.501250:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787548714.501257:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431875072:0@lo:400:kworker.0 00000100:00100000:3.0:1787548714.501281:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548714.501306:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431875328 00000100:00100000:3.0:1787548714.501311:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431875328 00000100:00100000:3.0:1787548714.501395:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431874944 00000100:00100000:3.0:1787548714.501399:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431874944 00000100:00100000:3.0:1787548714.501415:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431875072 00000100:00100000:3.0:1787548714.501418:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431875072 00000100:00100000:3.0:1787548714.501434:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787548714.501442:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874380431875328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548714.501487:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874380431875328:12345-0@lo:400:kworker.0 Request processed in 46us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548714.501493:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787548714.501508:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787548714.501514:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431874944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548714.501557:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431874944:12345-0@lo:400:kworker.0 Request processed in 43us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548714.501563:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787548714.501574:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787548714.501580:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431875072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548714.501603:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431875072:12345-0@lo:400:kworker.0 Request processed in 24us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548714.501609:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787548714.501625:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431875200 00000100:00100000:3.0:1787548714.501629:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431875200 00000100:00100000:3.0:1787548714.501663:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787548714.501669:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431875200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548714.501700:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431875200:12345-0@lo:400:kworker.0 Request processed in 31us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548714.501706:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787548714.501823:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431875456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548714.501851:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548714.501880:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431875072:0@lo:400:kworker.0 00000100:00100000:3.0:1787548714.501889:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431874944:0@lo:400:kworker.0 00000100:00080000:2.0:1787548714.501974:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787548714.501978:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787548714.501996:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecad283b80 x1874380431875200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548714.502008:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431875200:0@lo:400:kworker.0 00000100:00100000:2.0:1787548714.502016:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874380431875328:0@lo:400:kworker.0 00000100:00100000:1.0:1787548714.502172:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431875456 00000100:00100000:1.0:1787548714.502177:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431875456 00000100:00100000:1.0:1787548714.502202:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787548714.502208:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431875456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787548714.502230:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548714.502271:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431875456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548714.502277:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787548714.502368:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecad098000 x1874380431875456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548714.502381:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431875456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548714.503249:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431874816 00000100:00100000:0.0:1787548714.503256:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431874816 00000100:00100000:0.0:1787548714.503300:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787548714.503309:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3314:x1874380431874816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548714.503363:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3314:x1874380431874816:12345-0@lo:400:kworker.0 Request processed in 55us (2666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548714.503370:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787548714.503459:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431874816:0@lo:400:kworker.0 00010000:00010000:1.0:1787548715.459338:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548716.483491:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787548717.315880:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787548717.507398:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548718.136741:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548718.136794:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548718.136831:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548718.136863:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548718.136936:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416114048 00000100:00100000:1.0:1787548718.136956:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416114048 00000100:00100000:1.0:1787548718.137015:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416114304 00000100:00100000:1.0:1787548718.137018:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416114304 00000100:00100000:1.0:1787548718.137055:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 106 00000100:00100000:1.0:1787548718.137065:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2352:x1874380416114048:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548718.137160:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2352:x1874380416114048:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 96us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548718.137168:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 106 00000100:00100000:1.0:1787548718.137187:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 107 00000100:00100000:1.0:1787548718.137194:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92088e20-066b-499e-ac52-ab10992c506a+5:2352:x1874380416114304:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548718.137219:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92088e20-066b-499e-ac52-ab10992c506a+5:2352:x1874380416114304:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548718.137226:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 107 00000100:00100000:2.0:1787548718.137719:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416114176 00000100:00100000:2.0:1787548718.137725:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416114176 00000100:00100000:2.0:1787548718.137769:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 51 00000100:00100000:2.0:1787548718.137776:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416114176:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548718.137820:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416114176:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 45us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548718.137826:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 51 00000100:00080000:0.0:1787548718.137893:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787548718.137897:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548718.138116:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416113920 00000100:00100000:3.0:1787548718.138121:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416113920 00000100:00100000:3.0:1787548718.139179:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 274 00000100:00100000:3.0:1787548718.139191:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2351:x1874380416113920:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548718.139247:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2351:x1874380416113920:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 58us (2514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548718.139254:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 274 00010000:00010000:1.0:1787548718.537424:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548719.556172:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548719.619843:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431875584:0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.619921:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548719.619972:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431876096:0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.619999:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548719.620025:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787548719.620047:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431875968:0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.620076:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548719.620105:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431875840:0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.620154:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548719.620171:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787548719.620177:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431875712:0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.620200:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548719.620215:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431876224:0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.620249:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548719.620280:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431875584 00000100:00100000:2.0:1787548719.620287:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431875584 00000100:00100000:2.0:1787548719.620330:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787548719.620338:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3316:x1874380431875584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.620384:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3316:x1874380431875584:12345-0@lo:400:kworker.0 Request processed in 47us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548719.620392:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787548719.620421:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431875968 00000100:00100000:2.0:1787548719.620425:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431875968 00000100:00100000:2.0:1787548719.620454:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431876224 00000100:00100000:2.0:1787548719.620457:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431876224 00000100:00100000:2.0:1787548719.620478:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787548719.620485:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431875968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.620517:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431875968:12345-0@lo:400:kworker.0 Request processed in 33us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548719.620523:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787548719.620534:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787548719.620540:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431876224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.620580:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431876224:12345-0@lo:400:kworker.0 Request processed in 39us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548719.620586:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787548719.620604:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431876096 00000100:00100000:2.0:1787548719.620607:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431876096 00000100:00100000:2.0:1787548719.620631:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431875840 00000100:00100000:2.0:1787548719.620634:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431875840 00000100:00100000:2.0:1787548719.620646:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431875712 00000100:00100000:2.0:1787548719.620648:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431875712 00000100:00100000:2.0:1787548719.620660:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787548719.620666:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431876096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.620695:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431876096:12345-0@lo:400:kworker.0 Request processed in 29us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548719.620701:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787548719.620712:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787548719.620718:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431875840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.620742:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431875840:12345-0@lo:400:kworker.0 Request processed in 25us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548719.620748:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787548719.620758:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787548719.620764:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431875712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.620800:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431875712:12345-0@lo:400:kworker.0 Request processed in 36us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548719.620806:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787548719.620847:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431875712:0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.620857:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431876224:0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.620873:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431875840:0@lo:400:kworker.0 00010000:00080000:2.0:1787548719.620915:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8feca2f3df80 x1874380431875968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548719.620926:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431875968:0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.620934:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431875584:0@lo:400:kworker.0 00000100:00100000:2.0:1787548719.620943:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431876096:0@lo:400:kworker.0 00000100:00080000:0.0:1787548719.621223:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787548719.621229:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787548719.621231:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787548719.622049:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787548719.622062:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431876352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548719.622102:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548719.622199:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431876480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548719.622229:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548719.622298:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431876352 00000100:00100000:1.0:1787548719.622304:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431876352 00000100:00100000:1.0:1787548719.622329:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431876480 00000100:00100000:1.0:1787548719.622331:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431876480 00000100:00100000:1.0:1787548719.622343:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787548719.622350:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431876352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787548719.622387:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548719.622432:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431876352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548719.622438:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787548719.622453:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787548719.622459:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431876480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787548719.622474:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548719.622508:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431876480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548719.622513:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787548719.622641:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbf100 x1874380431876480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548719.622657:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431876480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548719.622687:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431876352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787548720.579391:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548721.604296:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548722.628172:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548723.256705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548723.256791:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548723.256820:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416114432 00000100:00100000:2.0:1787548723.256888:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416114560 00000100:00100000:2.0:1787548723.256899:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416114560 00000100:00100000:0.0:1787548723.256964:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416114432 00000100:00100000:2.0:1787548723.257014:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 111 00000100:00100000:0.0:1787548723.257022:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 276 00000100:00100000:2.0:1787548723.257028:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416114560:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548723.257034:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2353:x1874380416114432:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548723.257100:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2353:x1874380416114432:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 69us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548723.257102:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416114560:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 77us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548723.257117:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 276 00000100:00100000:2.0:1787548723.257118:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 111 00000100:00080000:1.0:1787548723.257213:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548723.269439:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548723.272350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548723.272600:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416114688 00000100:00100000:2.0:1787548723.272609:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416114688 00000100:00100000:2.0:1787548723.272690:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 19 00000100:00100000:2.0:1787548723.272701:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2350:x1874380416114688:12345-192.168.206.13@tcp:9:kworker.0 00000020:00000080:2.0:1787548723.272728:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e9ad 00000100:00080000:2.0:1787548723.272736:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8fecb7dc7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787548723.272801:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787548723.273075:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+2:2350:x1874380416114688:12345-192.168.206.13@tcp:9:kworker.0 Request processed in 375us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548723.273083:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 19 00010000:00010000:2.0:1787548723.273164:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548723.273484:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416114816 00000100:00100000:1.0:1787548723.273490:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416114816 00000100:00100000:1.0:1787548723.273533:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 112 00000100:00100000:1.0:1787548723.273540:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416114816:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548723.273572:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416114816:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 33us (4146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548723.273579:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 112 00000100:00080000:0.0:1787548723.273643:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787548723.273648:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787548723.651675:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548724.675340:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548724.740314:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787548724.741657:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431876608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548724.741736:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548724.742037:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431876608 00000100:00100000:1.0:1787548724.742045:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431876608 00000100:00100000:1.0:1787548724.742122:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787548724.742154:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431876608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787548724.742189:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548724.742253:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431876608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548724.742261:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787548724.742305:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431876608:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787548724.743511:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787548724.743536:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431876736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548724.743583:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548724.743626:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787548724.743632:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca00aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431876864:0@lo:400:kworker.0 00000100:00100000:0.0:1787548724.743659:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548724.743708:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431876864 00000100:00100000:0.0:1787548724.743713:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431876864 00000100:00100000:0.0:1787548724.743760:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787548724.743768:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431876864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548724.743810:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431876864:12345-0@lo:400:kworker.0 Request processed in 43us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548724.743818:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787548724.743856:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca00aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431876864:0@lo:400:kworker.0 00000100:00100000:0.0:1787548724.743883:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431876736 00000100:00100000:0.0:1787548724.743908:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431876736 00000100:00100000:0.0:1787548724.744521:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787548724.744529:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431876736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787548724.744555:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548724.744601:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431876736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548724.744608:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1787548724.744625:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787548724.744820:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbc700 x1874380431876736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548724.744837:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431876736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787548724.748286:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787548724.748318:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca00a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431876992:0@lo:400:kworker.0 00000100:00100000:2.0:1787548724.748390:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548724.748434:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431876992 00000100:00100000:2.0:1787548724.748441:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431876992 00000100:00100000:2.0:1787548724.748485:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787548724.748494:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431876992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548724.748543:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431876992:12345-0@lo:400:kworker.0 Request processed in 50us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548724.748550:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787548724.748588:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca00a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431876992:0@lo:400:kworker.0 00000100:00100000:2.0:1787548724.748618:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca00a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874380431877120:0@lo:400:kworker.0 00000100:00100000:2.0:1787548724.748637:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548724.748669:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787548724.748674:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca00a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874380431877248:0@lo:400:kworker.0 00000100:00100000:2.0:1787548724.748695:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548724.748713:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431877120 00000100:00100000:2.0:1787548724.748716:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431877120 00000100:00100000:2.0:1787548724.748762:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431877248 00000100:00100000:2.0:1787548724.748766:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431877248 00000100:00100000:2.0:1787548724.748784:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787548724.748789:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874380431877120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548724.748830:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874380431877120:12345-0@lo:400:kworker.0 Request processed in 40us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548724.748836:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787548724.748846:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787548724.748862:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874380431877248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548724.748928:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874380431877248:12345-0@lo:400:kworker.0 Request processed in 66us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548724.748934:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787548724.748981:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca00a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874380431877120:0@lo:400:kworker.0 00000100:00100000:2.0:1787548724.749000:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca00a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874380431877248:0@lo:400:kworker.0 00000100:00080000:0.0:1787548724.749175:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1787548725.337296:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000020:00000080:2.0:1787548725.337306:0:7647:0:(genops.c:885:class_export_put()) final put ffff8fecb7dc3800/e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000020:00000080:3.0:1787548725.337370:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecb7dc3800/e4505aba-b49a-4ae4-be2d-9f5ba513779c for lustre-OST0001 00000020:00000080:3.0:1787548725.337415:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fecb7dc7000 for lustre-OST0001 00010000:00010000:1.0:1787548725.701804:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548726.724582:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787548727.555998:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787548727.747606:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548728.379032:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548728.379116:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548728.379163:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548728.379191:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416115200 00000100:00100000:2.0:1787548728.379199:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416115200 00000100:00100000:2.0:1787548728.379252:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416115072 00000100:00100000:2.0:1787548728.379255:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416115072 00000100:00100000:2.0:1787548728.379280:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 116 00000100:00100000:2.0:1787548728.379289:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416115200:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548728.379358:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416115200:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 70us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548728.379366:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 116 00000100:00100000:2.0:1787548728.379386:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 117 00000100:00100000:2.0:1787548728.379405:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2354:x1874380416115072:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548728.379432:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2354:x1874380416115072:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 29us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548728.379450:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 117 00000100:00080000:2.0:1787548728.379488:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548728.384714:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416114944 00000100:00100000:0.0:1787548728.384740:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416114944 00000100:00100000:2.0:1787548728.389793:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 278 00000100:00100000:2.0:1787548728.389809:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2354:x1874380416114944:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548728.389939:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2354:x1874380416114944:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 134us (10915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548728.389947:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 278 00000001:02000400:0.0:1787548728.597982:0:11856:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:18:48 (1787548728) 00010000:00010000:0.0:1787548728.779688:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548729.795534:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548729.859360:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787548729.859383:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431877376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548729.859494:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548729.859564:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431877376 00000100:00100000:1.0:1787548729.859571:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431877376 00000100:00100000:1.0:1787548729.859623:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787548729.859632:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431877376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787548729.859664:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548729.859707:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431877376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548729.859714:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1787548729.859746:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787548729.859779:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431877376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548729.860126:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431877632:0@lo:400:kworker.0 00000100:00100000:3.0:1787548729.860270:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431877504:0@lo:400:kworker.0 00000100:00100000:0.0:1787548729.860544:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431877760:0@lo:400:kworker.0 00000100:00100000:2.0:1787548729.860782:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431877888:0@lo:400:kworker.0 00000100:00100000:3.0:1787548729.862517:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548729.862578:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431878016:0@lo:400:kworker.0 00000100:00100000:3.0:1787548729.862617:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548729.862695:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431877504 00000100:00100000:3.0:1787548729.862701:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431877504 00000100:00100000:3.0:1787548729.862759:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787548729.862769:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431877504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548729.862814:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431877504:12345-0@lo:400:kworker.0 Request processed in 47us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548729.862821:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787548729.862849:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431878016 00000100:00100000:3.0:1787548729.862852:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431878016 00000100:00100000:3.0:1787548729.862894:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787548729.862902:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431878016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548729.862932:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431878016:12345-0@lo:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548729.862938:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787548729.863235:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431877504:0@lo:400:kworker.0 00000100:00100000:3.0:1787548729.863250:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431878016:0@lo:400:kworker.0 00000100:00100000:3.0:1787548729.863265:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787548729.863272:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431878144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548729.863299:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787548729.863395:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548729.863405:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431878144 00000100:00100000:3.0:1787548729.863409:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431878144 00000100:00100000:3.0:1787548729.863437:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787548729.863444:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431878144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787548729.863482:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548729.863520:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431878144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548729.863527:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1787548729.863544:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787548729.863561:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb3dbc700 x1874380431878144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548729.863575:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431878144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548729.870154:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548729.871006:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431877632 00000100:00100000:3.0:1787548729.871017:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431877632 00000100:00100000:3.0:1787548729.871072:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787548729.871082:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431877632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548729.871175:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431877632:12345-0@lo:400:kworker.0 Request processed in 94us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548729.871182:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787548729.871314:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431877632:0@lo:400:kworker.0 00000100:00100000:0.0:1787548729.871770:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548729.871887:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431877760 00000100:00100000:3.0:1787548729.871892:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431877760 00000100:00100000:3.0:1787548729.871942:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787548729.871950:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431877760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548729.871993:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431877760:12345-0@lo:400:kworker.0 Request processed in 43us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548729.872000:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1787548729.872146:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548729.872179:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431877760:0@lo:400:kworker.0 00000100:00100000:2.0:1787548729.872402:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548729.872536:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431877888 00000100:00100000:3.0:1787548729.872541:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431877888 00000100:00100000:3.0:1787548729.872606:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787548729.872626:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431877888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548729.872673:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431877888:12345-0@lo:400:kworker.0 Request processed in 48us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548729.872679:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787548729.872743:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecbd0f2d80 x1874380431877888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787548745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548729.872754:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431877888:0@lo:400:kworker.0 00000100:00100000:2.0:1787548730.385227:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548730.385607:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416115328 00000100:00100000:3.0:1787548730.385617:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416115328 00000100:00100000:3.0:1787548730.385689:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 32 00000100:00100000:3.0:1787548730.385701:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:10230:x1874380416115328:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00000100:00080000:0.0:1787548730.385701:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787548730.385729:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548730.385781:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ea78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2205 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.385845:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424ea7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.385859:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424ea7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.385878:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424ea7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548730.386073:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787548730.386078:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548730.386192:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424ea7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.386219:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ea78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2205 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.386236:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424ea7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2205 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.386252:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93300) 00010000:00010000:3.0:1787548730.386255:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787548730.386259:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92600, rc 0) 00000100:00100000:3.0:1787548730.386317:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:10230:x1874380416115328:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 618us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548730.386324:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 32 00000100:00100000:1.0:1787548730.394823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548730.395445:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416115456 00000100:00100000:3.0:1787548730.395455:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416115456 00000100:00100000:3.0:1787548730.398428:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 33 00000100:00100000:3.0:1787548730.398446:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:10231:x1874380416115456:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787548730.398467:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548730.399375:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ea86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a220c expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.399452:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ea8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.399466:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ea8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.399478:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ea8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.400376:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424ea94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.400387:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424ea94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.400411:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424ea94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.403230:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92200/0xcb7c48919424ea9b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.403316:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92200/0xcb7c48919424ea9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.403329:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92200/0xcb7c48919424ea9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548730.403432:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787548730.403437:0:8467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548730.404127:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92200/0xcb7c48919424ea9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404334:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ea8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404341:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ea8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404348:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ea8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404353:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548730.404357:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ea8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404364:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ea8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404386:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93300) 00010000:00010000:3.0:1787548730.404389:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548730.404393:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ea8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404399:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ea8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404412:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424ea94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404418:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424ea94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404424:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424ea94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404429:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548730.404432:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424ea94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404438:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424ea94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404446:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8fec90d93700) 00010000:00010000:3.0:1787548730.404448:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548730.404451:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424ea94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404456:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424ea94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.404577:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ea86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a220c expref: 8 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.405176:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92200/0xcb7c48919424ea9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a220c expref: 7 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548730.405185:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fec90d93100) 00010000:00010000:3.0:1787548730.405187:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787548730.405190:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92200, rc 0) 00000100:00100000:3.0:1787548730.405360:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:10231:x1874380416115456:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 6919us (10543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548730.405369:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 33 00000100:00100000:2.0:1787548730.415471:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548730.415588:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416115712 00000100:00100000:1.0:1787548730.415597:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416115712 00000100:00100000:1.0:1787548730.415666:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 34 00000100:00100000:1.0:1787548730.415676:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:10231:x1874380416115712:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787548730.415694:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548730.415714:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e000/0xcb7c48919424eaa2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2213 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.415803:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424eaa9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.415815:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424eaa9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.415837:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424eaa9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.415913:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424eab0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.415922:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424eab0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.415929:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424eab0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417325:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f200/0xcb7c48919424eab7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417343:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f200/0xcb7c48919424eab7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417363:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f200/0xcb7c48919424eab7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548730.417375:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787548730.417811:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424eaa9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417820:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424eaa9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417827:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424eaa9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417843:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548730.417848:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424eaa9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417856:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424eaa9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417876:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fec90d93100) 00010000:00010000:1.0:1787548730.417879:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548730.417884:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424eaa9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417890:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424eaa9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417903:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424eab0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417909:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424eab0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417921:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424eab0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417927:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fe00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548730.417930:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424eab0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417936:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424eab0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417945:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8feca2d51900) 00010000:00010000:1.0:1787548730.417948:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548730.417951:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424eab0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.417956:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424eab0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.418984:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e000/0xcb7c48919424eaa2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2213 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.419004:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f200/0xcb7c48919424eab7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2213 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548730.419012:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8feca2d51a00) 00010000:00010000:1.0:1787548730.419015:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548730.419017:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22f200, rc 0) 00000100:00100000:1.0:1787548730.419216:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:10231:x1874380416115712:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 3540us (3752us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787548730.419235:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 34 00000100:00100000:3.0:1787548730.423658:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548730.424811:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416115840 00000100:00100000:1.0:1787548730.424823:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416115840 00000100:00100000:1.0:1787548730.425229:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 35 00000100:00100000:1.0:1787548730.425240:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:10231:x1874380416115840:12345-192.168.206.13@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787548730.425372:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:10231:x1874380416115840:12345-192.168.206.13@tcp:59:lhsmtool_posix.0 Request processed in 134us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548730.425380:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 35 00000040:00080000:1.0:1787548730.628328:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787548730.822021:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548731.845097:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548732.546866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548732.546968:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416115968 00000100:00100000:2.0:1787548732.546978:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416115968 00000100:00100000:2.0:1787548732.547045:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 36 00000100:00100000:2.0:1787548732.547056:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:10274:x1874380416115968:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548732.547075:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548732.547094:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eac5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a221a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547171:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eacc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547185:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eacc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547198:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eacc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547220:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ead3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547228:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ead3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547235:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ead3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547478:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eacc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547487:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eacc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547493:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eacc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547498:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ed200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548732.547503:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eacc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547509:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eacc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547520:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93300) 00010000:00010000:2.0:1787548732.547523:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548732.547527:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eacc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547533:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eacc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547549:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ead3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547555:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ead3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547561:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ead3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547567:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548732.547570:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ead3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547575:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ead3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547583:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8fec87cebf00) 00010000:00010000:2.0:1787548732.547586:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548732.547588:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ead3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547594:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ead3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547624:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eac5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a221a expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547633:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93300) 00010000:00010000:2.0:1787548732.547636:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548732.547646:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a221a expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.547656:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21edc00, rc 0) 00000100:00100000:2.0:1787548732.547721:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:10274:x1874380416115968:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 667us (862us total) trans 0 rc 301/301 00000100:00100000:2.0:1787548732.547728:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 36 00000100:00080000:0.0:1787548732.548021:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548732.558701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548732.558748:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416116224 00000100:00100000:2.0:1787548732.558758:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416116224 00000100:00100000:2.0:1787548732.558804:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 37 00000100:00100000:2.0:1787548732.558814:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:10274:x1874380416116224:12345-192.168.206.13@tcp:36:lfs.0 00010000:00010000:2.0:1787548732.558874:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548732.558899:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424ea7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2205 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.558915:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93300) 00010000:00010000:2.0:1787548732.558924:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787548732.559205:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eada lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.559221:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eada lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.559230:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eada lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.559243:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eae1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.559260:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eae1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.559266:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eae1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548732.560216:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787548732.560229:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eada lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.560237:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eada lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.560244:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eada lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.560249:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ede00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548732.560253:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eada lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.560261:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eada lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.560272:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec87ceb500) 00010000:00010000:2.0:1787548732.560276:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548732.560280:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eada lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.560286:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eada lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787548732.560314:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007433dc8 reply state 00000000b0f6aa7c transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eae1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548732.560322:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787548732.561300:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:10274:x1874380416116224:12345-192.168.206.13@tcp:36:lfs.0 Request processed in 2480us (2599us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787548732.561311:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 37 00010000:00010000:1.0:1787548732.566015:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eae1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.566030:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eae1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.566037:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eae1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.566042:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548732.566046:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eae1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.566053:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eae1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.566069:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8fec87ceb600) 00010000:00010000:1.0:1787548732.566072:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548732.566083:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eae1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.566090:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eae1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548732.639832:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548732.640012:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416116352 00000100:00100000:3.0:1787548732.640022:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416116352 00000100:00100000:3.0:1787548732.640083:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 38 00000100:00100000:3.0:1787548732.640093:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:10282:x1874380416116352:12345-192.168.206.13@tcp:101:lctl.0 00010000:00010000:3.0:1787548732.640119:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548732.640164:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424eae8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2221 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.640224:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424eaef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.640237:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424eaef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.640266:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424eaef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548732.640365:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787548732.640370:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548732.640416:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424eaef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.640442:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424eae8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2221 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.640460:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424eaef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2221 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.640469:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:2.0:1787548732.640472:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787548732.640475:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92e00, rc 0) 00000100:00100000:2.0:1787548732.640536:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:10282:x1874380416116352:12345-192.168.206.13@tcp:101:lctl.0 Request processed in 444us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548732.640543:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 38 00000100:00100000:1.0:1787548732.719783:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548732.720219:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416116480 00000100:00100000:3.0:1787548732.720235:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416116480 00000100:00100000:3.0:1787548732.720339:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 39 00000100:00100000:3.0:1787548732.720354:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:10288:x1874380416116480:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:3.0:1787548732.720381:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548732.720410:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eaf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2228 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.720814:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424eafd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.720833:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424eafd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.720862:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424eafd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.720880:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.720887:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.720893:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721035:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92000/0xcb7c48919424eb0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721064:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92000/0xcb7c48919424eb0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721071:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92000/0xcb7c48919424eb0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548732.721113:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787548732.721118:0:8467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548732.721197:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92000/0xcb7c48919424eb0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721212:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424eafd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721218:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424eafd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721226:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424eafd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721233:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548732.721238:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424eafd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721247:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424eafd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721271:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:3.0:1787548732.721274:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548732.721280:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424eafd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721674:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424eafd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721693:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721700:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721716:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721722:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548732.721725:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721732:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721743:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8fec90d93400) 00010000:00010000:3.0:1787548732.721746:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548732.721749:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721755:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721795:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eaf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2228 expref: 12 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721810:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92000/0xcb7c48919424eb0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2228 expref: 11 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.721824:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:3.0:1787548732.721837:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787548732.721841:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92000, rc 0) 00000100:00100000:3.0:1787548732.722237:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+11:10288:x1874380416116480:12345-192.168.206.13@tcp:101:bash.0 Request processed in 1884us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548732.722248:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 39 00000100:00100000:1.0:1787548732.744084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548732.744237:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416116736 00000100:00100000:2.0:1787548732.744248:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416116736 00000100:00100000:2.0:1787548732.744437:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 40 00000100:00100000:2.0:1787548732.744463:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+11:10288:x1874380416116736:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:2.0:1787548732.744485:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548732.744503:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a222f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.744627:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb19 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.744642:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.744652:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.744714:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eb20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.744722:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eb20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.744730:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eb20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787548732.745828:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787548732.746007:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424eb27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.746019:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424eb27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.746029:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424eb27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.746064:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.746071:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb19 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.746079:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.746084:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548732.746089:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.746096:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb19 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.746120:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:1.0:1787548732.746124:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548732.746149:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb19 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.746157:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787548732.746171:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037da3234 reply state 00000000b7335f73 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eb20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548732.746180:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787548732.746212:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a222f expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.746228:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424eb27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a222f expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.746236:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2d51900) 00010000:00010000:1.0:1787548732.746238:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787548732.746241:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22f000, rc 0) 00000100:00100000:1.0:1787548732.746398:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:10288:x1874380416116736:12345-192.168.206.13@tcp:101:bash.0 Request processed in 1936us (2323us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787548732.746406:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 40 00010000:00010000:3.0:1787548732.751050:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eb20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.751073:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eb20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.751103:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eb20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.751110:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ed200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548732.751116:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eb20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.751186:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eb20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.751216:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fec87ceb500) 00010000:00010000:3.0:1787548732.751220:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548732.751227:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eb20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.751234:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424eb20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548732.754246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548732.754564:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416116864 00000100:00100000:3.0:1787548732.754573:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416116864 00000100:00100000:3.0:1787548732.754634:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00100000:3.0:1787548732.754642:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1874380416116864:12345-192.168.206.13@tcp:8:bash.0 00010000:00080000:3.0:1787548732.754669:0:10297:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:3.0:1787548732.754714:0:10297:0:(genops.c:1385:class_connect()) connect: client e4505aba-b49a-4ae4-be2d-9f5ba513779c, cookie 0xcb7c48919424eb35 00002000:00100000:3.0:1787548732.754726:0:10297:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e4505aba-b49a-4ae4-be2d-9f5ba513779c/ffff8fec83669800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787548732.754932:0:10297:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787548732.755123:0:10297:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787548732.755212:0:10297:0:(import.c:65:import_set_state_nolock()) ffff8fec8366e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787548732.755333:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2350:x1874380416116864:12345-192.168.206.13@tcp:8:bash.0 Request processed in 689us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548732.755341:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00100000:2.0:1787548732.757903:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548732.758090:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416116992 00000100:00100000:0.0:1787548732.758099:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416116992 00000100:00080000:3.0:1787548732.759882:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548732.760632:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 21 00000100:00100000:1.0:1787548732.760648:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:0:x1874380416116992:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:1.0:1787548732.760681:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548732.760715:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424eb3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2236 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787548732.760745:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548732.760761:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=355s v=(0 0) 00010000:00010000:1.0:1787548732.760765:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548732.760775:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424eb3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2236 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.760796:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424eb3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2236 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.760808:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22f600, rc 0) 00000100:00100000:1.0:1787548732.760890:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:0:x1874380416116992:12345-192.168.206.13@tcp:101:bash.0 Request processed in 248us (2995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548732.760897:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 21 00000100:00100000:2.0:1787548732.773618:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548732.773742:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416117120 00000100:00100000:1.0:1787548732.773751:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416117120 00000100:00100000:1.0:1787548732.773803:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 22 00000100:00100000:1.0:1787548732.773813:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:10288:x1874380416117120:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:1.0:1787548732.773831:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548732.773847:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a223d expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.773987:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424eb3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2236 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.774007:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548732.774011:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548732.774017:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.774049:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424eb3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2236 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.774063:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424eb3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2236 expref: 8 pid: 6691 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548732.774077:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad6e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1874380431878272:192.168.206.13@tcp:104: 00000100:00100000:1.0:1787548732.774925:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecace21240 going to sleep for 11 seconds 00000100:00100000:0.0:1787548732.781753:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548732.781861:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416117248 00000100:00100000:2.0:1787548732.781871:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416117248 00010000:00010000:2.0:1787548732.781908:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424eb3c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2236 expref: 9 pid: 6691 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548732.781957:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 35 00000100:00100000:2.0:1787548732.781980:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2351:x1874380416117248:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548732.781994:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548732.782015:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424eb3c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2236 expref: 9 pid: 6691 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.782029:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424eb3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2236 expref: 9 pid: 6691 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.782055:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548732.782060:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548732.782068:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.782078:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.782112:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548732.782125:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca00ab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5839:1874380431878400:192.168.206.13@tcp:105: 00000100:00100000:2.0:1787548732.782244:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a300 going to sleep for 11 seconds 00010000:00010000:1.0:1787548732.782649:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424eb3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2236 expref: 9 pid: 6691 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548732.782664:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad6e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1874380431878272:192.168.206.13@tcp:104: 00010000:00010000:1.0:1787548732.782689:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548732.782699:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22fe00, rc 0) 00000100:00100000:1.0:1787548732.782750:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:10288:x1874380416117120:12345-192.168.206.13@tcp:101:bash.0 Request processed in 8938us (9140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548732.782778:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 22 00000100:00100000:2.0:1787548732.784815:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca00ab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5839:1874380431878400:192.168.206.13@tcp:105: 00010000:00010000:2.0:1787548732.784838:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548732.784903:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2351:x1874380416117248:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 2920us (3154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548732.784926:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 35 00000100:00100000:2.0:1787548732.792079:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548732.792250:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416117504 00000100:00100000:3.0:1787548732.792258:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416117504 00000100:00100000:2.0:1787548732.792683:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 6 00000100:00100000:2.0:1787548732.792694:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:10288:x1874380416117504:12345-192.168.206.13@tcp:35:bash.0 00000100:00100000:2.0:1787548732.793446:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:10288:x1874380416117504:12345-192.168.206.13@tcp:35:bash.0 Request processed in 750us (1371us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787548732.793456:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 6 00000100:00100000:3.0:1787548732.863084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548732.863215:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416117760 00000100:00100000:2.0:1787548732.863224:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416117760 00000100:00100000:2.0:1787548732.863281:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 41 00000100:00100000:2.0:1787548732.863291:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:10298:x1874380416117760:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548732.863416:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548732.863434:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2244 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548732.863553:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787548732.863657:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb4a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2244 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.863670:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:2.0:1787548732.863673:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787548732.863678:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2244 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.863691:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21edc00, rc 0) 00000100:00100000:2.0:1787548732.863762:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:10298:x1874380416117760:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 472us (686us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787548732.863769:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 41 00010000:00010000:1.0:1787548732.868345:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548732.869240:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548732.869321:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416118016 00000100:00100000:3.0:1787548732.869330:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416118016 00000100:00100000:3.0:1787548732.869374:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:3.0:1787548732.869385:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:10298:x1874380416118016:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:3.0:1787548732.869964:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:10298:x1874380416118016:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 578us (728us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787548732.869972:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:0.0:1787548732.928762:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548732.928933:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416118144 00000100:00100000:2.0:1787548732.928942:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416118144 00000100:00100000:2.0:1787548732.929057:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 42 00000100:00100000:2.0:1787548732.929068:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:10304:x1874380416118144:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548732.929089:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548732.929109:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a224b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.929525:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.929539:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.929549:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548732.929611:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787548732.929614:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548732.929637:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.929662:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a224b expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.929679:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a224b expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.929702:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:2.0:1787548732.929716:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787548732.929720:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ec200, rc 0) 00000100:00100000:2.0:1787548732.929826:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:10304:x1874380416118144:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 759us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548732.929833:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 42 00000100:00100000:1.0:1787548732.934556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548732.934713:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416118400 00000100:00100000:3.0:1787548732.934734:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416118400 00000100:00100000:3.0:1787548732.934926:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 43 00000100:00100000:3.0:1787548732.934936:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:10304:x1874380416118400:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548732.934953:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548732.934971:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eb66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2252 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.935070:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.935082:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.935092:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548732.935101:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787548732.935239:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eb66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2252 expref: 20 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.935255:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2252 expref: 19 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.935262:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2d51900) 00010000:00010000:3.0:1787548732.935276:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787548732.935280:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93600, rc 0) 00000100:00100000:3.0:1787548732.935331:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:10304:x1874380416118400:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 397us (785us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787548732.935338:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 43 00000100:00100000:1.0:1787548732.939282:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548732.939474:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416118656 00000100:00100000:2.0:1787548732.939483:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416118656 00000100:00100000:2.0:1787548732.939543:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 44 00000100:00100000:2.0:1787548732.939553:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:10304:x1874380416118656:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548732.939576:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548732.939604:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2259 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.939691:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eb82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.939714:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eb82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.939726:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eb82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548732.939747:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787548732.939862:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2259 expref: 22 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.939898:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eb82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2259 expref: 21 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.939906:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2d51900) 00010000:00010000:2.0:1787548732.939909:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787548732.939912:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ede00, rc 0) 00000100:00100000:2.0:1787548732.939973:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:10304:x1874380416118656:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 421us (710us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787548732.939980:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 44 00000100:00100000:1.0:1787548732.941346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548732.942467:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416118784 00000100:00100000:0.0:1787548732.942479:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416118784 00000100:00100000:0.0:1787548732.942579:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 2 00000100:00100000:0.0:1787548732.942589:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:2351:x1874380416118784:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548732.942615:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548732.942637:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eb6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2252 expref: 21 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548732.942654:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2d51900) 00010000:00010000:0.0:1787548732.942659:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548732.942723:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:2351:x1874380416118784:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 135us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548732.942729:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 2 00000100:00100000:1.0:1787548732.947535:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548732.947665:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416118912 00000100:00100000:2.0:1787548732.947674:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416118912 00000100:00100000:2.0:1787548732.947736:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 23 00000100:00100000:2.0:1787548732.947745:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2352:x1874380416118912:12345-192.168.206.13@tcp:1:lfs.0 00010000:00010000:2.0:1787548732.947784:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424eb90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.947803:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.947811:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548732.947815:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787548732.947820:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424eb90 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.947851:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.947875:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 7 pid: 6690 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548732.947889:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca00abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1874380431878528:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548732.947968:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787548732.952436:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548732.952551:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca00abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1874380431878528:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548732.952575:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424eb90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548732.952696:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416119040 00000100:00100000:0.0:1787548732.952712:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416119040 00002000:00100000:0.0:1787548732.952759:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8feca00ab800 x1874380416119040/t0(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:173/0 lens 504/0 e 0 to 0 dl 1787548743 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787548732.952768:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8feca00ab800 with x1874380416119040 ext(0->12) 00010000:00010000:0.0:1787548732.952774:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 8 pid: 6690 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548732.952786:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 8 pid: 6690 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787548732.952807:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8feca00ab800 00000100:00100000:0.0:1787548732.952886:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 0 00000100:00100000:0.0:1787548732.952897:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2351:x1874380416119040:12345-192.168.206.13@tcp:4:lfs.0 00000001:00100000:2.0:1787548732.975686:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000100:00100000:3.0:1787548732.976456:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2351:x1874380416119040:12345-192.168.206.13@tcp:4:lfs.0 Request processed in 23556us (24022us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787548732.976472:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 0 00002000:00100000:3.0:1787548732.976483:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8feca00ab800 x1874380416119040/t4294967299(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:173/0 lens 504/448 e 0 to 0 dl 1787548743 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787548732.976493:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8feca00ab800 with x1874380416119040 ext(0->12) 00010000:00010000:3.0:1787548732.976503:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 9 pid: 6690 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.976521:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 9 pid: 6690 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787548732.976529:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8feca00ab800 00000100:00100000:2.0:1787548732.979944:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548732.980056:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416119168 00000100:00100000:3.0:1787548732.980064:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416119168 00010000:00010000:3.0:1787548732.980097:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 9 pid: 6690 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548732.980163:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 36 00000100:00100000:3.0:1787548732.980171:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2351:x1874380416119168:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548732.980184:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787548732.980212:0:5841:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787548732.980214:0:5841:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787548733 00002000:00010000:3.0:1787548732.980217:0:5841:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787548733 00002000:00010000:3.0:1787548732.980219:0:5841:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787548733 00010000:00010000:3.0:1787548732.980224:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 9 pid: 6690 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.980237:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 9 pid: 6690 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.980258:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094044bb2/0xcb7c48919424eb43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a223d expref: 9 pid: 6690 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.980381:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787548732.980386:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787548732.980392:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424eb90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.980402:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424eb90 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.980432:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548732.980473:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2351:x1874380416119168:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 303us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548732.980480:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 36 00010000:00010000:2.0:1787548732.980534:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424eb90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.980544:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424eb90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.980567:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424eb90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.980576:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424eb90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.980584:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424eb90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.980601:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec400 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548732.980612:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424eb90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.980622:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424eb90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.980634:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424eb90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.980641:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424eb90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548732.980683:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2352:x1874380416118912:12345-192.168.206.13@tcp:1:lfs.0 Request processed in 32940us (33157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548732.980691:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 23 00000100:00100000:1.0:1787548732.983928:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548732.984003:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416119424 00000100:00100000:2.0:1787548732.984012:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416119424 00000100:00100000:2.0:1787548732.984061:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 8 00000100:00100000:2.0:1787548732.984070:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:10304:x1874380416119424:12345-192.168.206.13@tcp:35:lfs.0 00000004:00010000:2.0:1787548732.984124:0:5858:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eb82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2259 expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787548732.984419:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787548732.984467:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787548732.985022:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787548732.985074:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.985098:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424eb27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a222f expref: 24 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.985107:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.985174:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424eb27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a222f expref: 24 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.985188:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424eb27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a222f expref: 24 pid: 5856 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548732.985203:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca00aa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5858:1874380431878656:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548732.985281:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787548732.989179:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548732.989260:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416119552 00000100:00100000:3.0:1787548732.989278:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416119552 00010000:00010000:3.0:1787548732.989317:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424eb27 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a222f expref: 25 pid: 5856 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548732.989356:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 37 00000100:00100000:3.0:1787548732.989365:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+25:2351:x1874380416119552:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548732.989377:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548732.989384:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424eb27 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a222f expref: 25 pid: 5856 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.989396:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424eb27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a222f expref: 25 pid: 5856 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.989417:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2d51900) 00010000:00010000:3.0:1787548732.989422:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.989431:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.989439:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548732.989453:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548732.989490:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+25:2351:x1874380416119552:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 127us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548732.989497:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 37 00010000:00010000:2.0:1787548732.990072:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424eb27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a222f expref: 24 pid: 5856 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548732.990089:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca00aa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5858:1874380431878656:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548732.990108:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.990117:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548732.990123:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787548732.990254:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787548732.990448:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787548732.990554:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca00aa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431878784:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787548732.990644:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548732.990677:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548732.990920:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431878784 00000100:00100000:0.0:1787548732.990926:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431878784 00000100:00100000:0.0:1787548732.990986:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787548732.990994:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1874380431878784:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787548732.991058:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1874380431878784:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 65us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548732.991065:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787548732.991094:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca00aa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431878784:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787548732.991678:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1787548732.991750:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec87e93800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431878912:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787548732.991780:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548732.991795:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1540 going to sleep for 11 seconds 00000100:00100000:0.0:1787548732.991808:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431878912 00000100:00100000:0.0:1787548732.991811:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431878912 00000100:00100000:0.0:1787548732.991829:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787548732.991834:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1874380431878912:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787548732.991949:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5858:x1874380431878912:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 114us (168us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787548732.991956:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787548732.991982:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec87e93800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431878912:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787548732.992022:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1787548732.992050:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548732.992058:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548732.992066:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548732.992072:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21edc00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548732.992076:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548732.992084:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548732.992097:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2d51900) 00010000:00010000:0.0:1787548732.992099:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787548732.992103:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548732.992109:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424eb97 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787548732.992259:0:5858:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787548732.992432:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787548732.992442:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355869311338ns, next at 356869309612ns, rc = 0 00000001:00080000:0.0:1787548732.992448:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1787548732.992474:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2d51900) 00010000:00010000:0.0:1787548732.992477:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787548732.992488:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424eb82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2259 expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548732.992566:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+27:10304:x1874380416119424:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 8497us (8646us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787548732.992574:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 8 00000020:00080000:0.0:1787548732.992577:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1787548732.993286:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787548733.000035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548733.000115:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416119680 00000100:00100000:2.0:1787548733.000124:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416119680 00000100:00100000:2.0:1787548733.000359:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 45 00000100:00100000:2.0:1787548733.000370:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+27:10304:x1874380416119680:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548733.000392:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548733.000411:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eb9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2260 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.000462:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eb9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2260 expref: 28 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.000476:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eb9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2260 expref: 28 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.000492:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548733.000495:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787548733.000498:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ec400, rc 0) 00000100:00100000:2.0:1787548733.000549:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+28:10304:x1874380416119680:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 181us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548733.000556:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 45 00000100:00100000:0.0:1787548733.009893:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548733.010001:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416119936 00000100:00100000:3.0:1787548733.010010:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416119936 00000100:00100000:3.0:1787548733.010063:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00100000:3.0:1787548733.010072:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f34450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+28:10304:x1874380416119936:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:3.0:1787548733.010333:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f34450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+29:10304:x1874380416119936:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 261us (446us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787548733.010341:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00100000:1.0:1787548733.168853:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548733.168947:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416120192 00000100:00100000:3.0:1787548733.168958:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416120192 00000100:00100000:3.0:1787548733.169019:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 46 00000100:00100000:3.0:1787548733.169029:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+29:10314:x1874380416120192:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548733.169055:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548733.169074:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eba5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2267 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548733.169220:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787548733.169335:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eba5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2267 expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.169349:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:3.0:1787548733.169352:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787548733.169356:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eba5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2267 expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.169369:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92800, rc 0) 00000100:00100000:3.0:1787548733.169426:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+30:10314:x1874380416120192:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 398us (583us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1787548733.169434:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 46 00000100:00100000:2.0:1787548733.171890:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548733.171969:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416120320 00000100:00100000:3.0:1787548733.171979:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416120320 00000100:00100000:3.0:1787548733.172034:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 47 00000100:00100000:3.0:1787548733.172056:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+30:10314:x1874380416120320:12345-192.168.206.13@tcp:34:lfs.0 00010000:00010000:3.0:1787548733.172124:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172160:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172172:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172187:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172193:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172198:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172284:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ebc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172291:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ebc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172297:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ebc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787548733.172336:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ebc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172347:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172359:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172366:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172371:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548733.172375:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172381:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172392:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:3.0:1787548733.172395:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548733.172399:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172404:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172417:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172422:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172427:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172431:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548733.172439:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172446:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172453:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fec90d93800) 00010000:00010000:3.0:1787548733.172455:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548733.172458:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172464:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172488:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ebc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172494:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ebc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172500:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ebc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172505:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548733.172508:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ebc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172513:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ebc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172521:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:3.0:1787548733.172524:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548733.172533:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ebc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.172538:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ebc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548733.172810:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+30:10314:x1874380416120320:12345-192.168.206.13@tcp:34:lfs.0 Request processed in 755us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548733.172819:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 47 00000100:00100000:0.0:1787548733.180963:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548733.181124:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416120576 00000100:00100000:1.0:1787548733.181148:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416120576 00000100:00100000:1.0:1787548733.181202:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:1.0:1787548733.181212:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+30:10314:x1874380416120576:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:1.0:1787548733.181439:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+31:10314:x1874380416120576:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 227us (484us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787548733.181447:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:1.0:1787548733.244048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548733.244125:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416120832 00000100:00100000:3.0:1787548733.244165:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416120832 00000100:00100000:3.0:1787548733.244226:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 48 00000100:00100000:3.0:1787548733.244236:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+31:10317:x1874380416120832:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548733.244260:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548733.244280:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ebc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a226e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.244352:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebcf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.244365:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.244376:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.244389:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.244396:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.244416:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.244862:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ebdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.244871:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ebdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.244878:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ebdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548733.244886:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787548733.244970:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.244977:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebcf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.244983:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.244989:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548733.244993:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.244999:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebcf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.245011:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:3.0:1787548733.245014:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548733.245025:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.245031:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ebcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.245045:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.245051:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.245056:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.245061:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548733.245065:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.245071:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.245078:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fec90d93800) 00010000:00010000:3.0:1787548733.245080:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548733.245083:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.245088:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ebd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.245208:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ebc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a226e expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.245239:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ebdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a226e expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.245246:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:3.0:1787548733.245248:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787548733.245250:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92800, rc 0) 00000100:00100000:3.0:1787548733.245321:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+33:10317:x1874380416120832:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 1086us (1280us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1787548733.245328:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 48 00000100:00100000:2.0:1787548733.255347:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548733.255428:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416120960 00000100:00100000:3.0:1787548733.255437:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416120960 00000100:00100000:3.0:1787548733.255501:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 49 00000100:00100000:3.0:1787548733.255510:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+33:10317:x1874380416120960:12345-192.168.206.13@tcp:54:lfs.0 00010000:00010000:3.0:1787548733.255574:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ebeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.255591:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ebeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.255613:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ebeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.255638:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ebeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.255644:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ebeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.255667:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ebeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.255673:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548733.255677:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ebeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.255684:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ebeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.255696:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:3.0:1787548733.255700:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787548733.255715:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ebeb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.255722:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ebeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548733.255791:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+33:10317:x1874380416120960:12345-192.168.206.13@tcp:54:lfs.0 Request processed in 281us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548733.255798:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 49 00000100:00100000:1.0:1787548733.258115:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548733.258240:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416121216 00000100:00100000:3.0:1787548733.258248:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416121216 00000100:00100000:3.0:1787548733.258290:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:3.0:1787548733.258300:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+33:10317:x1874380416121216:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:3.0:1787548733.258511:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+34:10317:x1874380416121216:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 212us (403us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787548733.258519:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:1.0:1787548733.495192:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548733.495238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548733.495264:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548733.495354:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416121344 00000100:00100000:0.0:1787548733.495363:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416121344 00000100:00100000:0.0:1787548733.495407:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 280 00000100:00100000:0.0:1787548733.495415:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2354:x1874380416121344:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548733.495485:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2354:x1874380416121344:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 70us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548733.495493:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 280 00000100:00100000:3.0:1787548733.495986:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416121472 00000100:00100000:3.0:1787548733.495992:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416121472 00000100:00100000:3.0:1787548733.496036:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 55 00000100:00100000:3.0:1787548733.496044:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2354:x1874380416121472:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548733.496086:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2354:x1874380416121472:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 43us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548733.496094:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 55 00000100:00100000:2.0:1787548733.499928:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416121600 00000100:00100000:2.0:1787548733.499943:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416121600 00000100:00100000:2.0:1787548733.509082:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 121 00000100:00100000:2.0:1787548733.509097:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416121600:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548733.509192:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416121600:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 99us (13926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548733.509200:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 121 00000100:00080000:1.0:1787548733.511519:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548733.586518:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548733.586792:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416121856 00000100:00100000:2.0:1787548733.586806:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416121856 00000100:00100000:2.0:1787548733.586882:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 50 00000100:00100000:2.0:1787548733.586893:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+34:10348:x1874380416121856:12345-192.168.206.13@tcp:101:cat.0 00010000:00010000:2.0:1787548733.586918:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548733.586939:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ebf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2275 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.587029:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ebf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.587044:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ebf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.587057:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ebf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548733.587069:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787548733.587256:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ebf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2275 expref: 37 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.587276:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ebf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2275 expref: 36 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.587303:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548733.587306:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548733.587309:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21edc00, rc 0) 00000100:00100000:2.0:1787548733.587383:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+36:10348:x1874380416121856:12345-192.168.206.13@tcp:101:cat.0 Request processed in 492us (881us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787548733.587390:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 50 00000100:00100000:0.0:1787548733.591417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548733.595118:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416121984 00000100:00100000:2.0:1787548733.595153:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416121984 00000100:00100000:2.0:1787548733.595250:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 3 00000100:00100000:2.0:1787548733.595274:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+36:2352:x1874380416121984:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548733.595291:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548733.595591:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ebf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2275 expref: 36 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.595613:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548733.595618:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548733.595982:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+35:2352:x1874380416121984:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 721us (4570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548733.595991:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 3 00000100:00100000:1.0:1787548733.596367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548733.596784:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416122240 00000100:00100000:3.0:1787548733.596798:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416122240 00000100:00100000:3.0:1787548733.597741:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:3.0:1787548733.597761:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+35:10348:x1874380416122240:12345-192.168.206.13@tcp:35:cat.0 00000100:00100000:3.0:1787548733.599279:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+36:10348:x1874380416122240:12345-192.168.206.13@tcp:35:cat.0 Request processed in 1513us (2900us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787548733.599293:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:1.0:1787548733.714340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548733.714492:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416122496 00000100:00100000:2.0:1787548733.714506:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416122496 00000100:00100000:2.0:1787548733.714587:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 51 00000100:00100000:2.0:1787548733.714600:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+36:10354:x1874380416122496:12345-192.168.206.13@tcp:101:dd.0 00010000:00010000:2.0:1787548733.714634:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548733.714638:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787548733.714695:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eb5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a224b expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.714731:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:2.0:1787548733.714737:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787548733.714755:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ec07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a227c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.714901:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.714918:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ebdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a226e expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.714927:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.714968:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ebdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a226e expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.714983:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ebdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a226e expref: 36 pid: 5854 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548733.715000:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1874380431879040:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548733.715123:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a300 going to sleep for 11 seconds 00000100:00100000:1.0:1787548733.720305:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548733.721548:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1874380431879040:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548733.721601:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548733.721859:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416122624 00000100:00100000:3.0:1787548733.721870:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416122624 00010000:00010000:3.0:1787548733.721922:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ebdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a226e expref: 37 pid: 5854 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548733.721978:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 38 00000100:00100000:3.0:1787548733.721990:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+37:2351:x1874380416122624:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548733.722011:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548733.722019:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ebdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a226e expref: 37 pid: 5854 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.722044:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ebdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a226e expref: 37 pid: 5854 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.722071:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ebdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a226e expref: 37 pid: 5854 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.722089:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:3.0:1787548733.722094:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.722104:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.722113:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548733.722177:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548733.722251:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+36:2351:x1874380416122624:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 262us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548733.722269:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 38 00010000:00010000:2.0:1787548733.722546:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.722555:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548733.722579:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787548733.722839:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ec07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a227c expref: 37 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.722868:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a227c expref: 36 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.722877:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548733.722880:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787548733.722882:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ed200, rc 0) 00000100:00100000:2.0:1787548733.722916:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+36:10354:x1874380416122496:12345-192.168.206.13@tcp:101:dd.0 Request processed in 8319us (8600us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787548733.722924:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 51 00000100:00100000:3.0:1787548733.728754:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548733.728897:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416122880 00000100:00100000:2.0:1787548733.728911:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416122880 00000100:00100000:2.0:1787548733.728979:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 52 00000100:00100000:2.0:1787548733.728991:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+36:10354:x1874380416122880:12345-192.168.206.13@tcp:36:dd.0 00010000:00010000:2.0:1787548733.729535:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.729558:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.729590:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787548733.729652:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787548733.729683:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000772ea931 reply state 00000000f70427ec transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548733.729694:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787548733.729822:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:10354:x1874380416122880:12345-192.168.206.13@tcp:36:dd.0 Request processed in 831us (1084us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787548733.729830:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 52 00000020:00080000:2.0:1787548733.729836:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787548733.739732:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.739757:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.739766:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.739773:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548733.739778:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.739786:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.739809:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548733.739812:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548733.739846:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.739853:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548733.895809:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548734.069249:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548734.069688:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416123008 00000100:00100000:0.0:1787548734.069713:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416123008 00000100:00100000:0.0:1787548734.069816:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 53 00000100:00100000:0.0:1787548734.069829:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+38:10368:x1874380416123008:12345-192.168.206.13@tcp:101:stat.0 00010000:00010000:0.0:1787548734.069870:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548734.069897:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ec23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2283 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.069978:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ec2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.070011:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ec2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.070025:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ec2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.070041:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.070048:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.070055:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.070211:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ec38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.070223:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a227c expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.070232:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ec38 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.070271:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a227c expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.070286:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a227c expref: 39 pid: 5856 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548734.070314:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcef6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431879168:192.168.206.13@tcp:104: 00000100:00100000:0.0:1787548734.070452:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1000 going to sleep for 11 seconds 00000100:00080000:1.0:1787548734.071255:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787548734.074087:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548734.074229:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416123264 00000100:00100000:2.0:1787548734.074240:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416123264 00000100:00100000:2.0:1787548734.074306:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 13 00000100:00100000:2.0:1787548734.074317:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+40:5592:x1874380416123264:12345-192.168.206.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787548734.074912:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+41:5592:x1874380416123264:12345-192.168.206.13@tcp:35:ldlm_bl.0 Request processed in 594us (836us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787548734.074923:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 13 00000100:00100000:0.0:1787548734.076225:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcef6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431879168:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548734.076260:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ec38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548734.080076:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548734.080944:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416123392 00000100:00100000:1.0:1787548734.080960:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416123392 00010000:00010000:1.0:1787548734.081018:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a227c expref: 41 pid: 5856 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548734.081072:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 39 00000100:00100000:1.0:1787548734.081084:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+41:2352:x1874380416123392:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548734.081102:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548734.081110:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a227c expref: 41 pid: 5856 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548734.081125:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a227c expref: 41 pid: 5856 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548734.081186:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a227c expref: 41 pid: 5856 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548734.081206:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:1.0:1787548734.081212:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ec38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548734.081223:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ec38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548734.081231:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ec38 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548734.081270:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548734.081364:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+40:2352:x1874380416123392:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 282us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548734.081373:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 39 00010000:00010000:0.0:1787548734.082891:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ec38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.082910:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ec38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548734.082979:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787548734.082985:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548734.083049:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ec38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083067:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ec38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083080:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ec2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083087:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ec2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083095:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ec2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083102:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548734.083120:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ec2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083169:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ec2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083189:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:0.0:1787548734.083193:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548734.083197:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ec2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083203:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ec2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083219:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083225:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083232:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083238:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548734.083241:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083247:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083255:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8feca2cf6000) 00010000:00010000:0.0:1787548734.083257:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548734.083267:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083274:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083324:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ec23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2283 expref: 40 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083342:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ec38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2283 expref: 39 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.083350:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:0.0:1787548734.083352:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548734.083355:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150400, rc 0) 00000100:00100000:0.0:1787548734.083428:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:10368:x1874380416123008:12345-192.168.206.13@tcp:101:stat.0 Request processed in 13601us (14191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548734.083438:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 53 00000100:00100000:3.0:1787548734.171032:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548734.171237:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416123648 00000100:00100000:2.0:1787548734.171250:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416123648 00000100:00100000:2.0:1787548734.171326:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 54 00000100:00100000:2.0:1787548734.171338:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:10374:x1874380416123648:12345-192.168.206.13@tcp:36:truncate.0 00010000:00010000:2.0:1787548734.171414:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548734.171652:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ec38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2283 expref: 39 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.171678:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548734.171684:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787548734.172387:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.172407:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.172450:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787548734.172518:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787548734.172548:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070fbfa29 reply state 000000007336c084 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548734.172558:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787548734.172722:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+41:10374:x1874380416123648:12345-192.168.206.13@tcp:36:truncate.0 Request processed in 1384us (1811us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787548734.172732:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 54 00000020:00080000:2.0:1787548734.172738:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787548734.179605:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.179628:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.179637:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.179643:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548734.179649:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.179658:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.179681:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548734.179684:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548734.179721:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.179728:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548734.359427:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548734.359656:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416123776 00000100:00100000:2.0:1787548734.359671:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416123776 00000100:00100000:2.0:1787548734.359949:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 55 00000100:00100000:2.0:1787548734.359962:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+40:10388:x1874380416123776:12345-192.168.206.13@tcp:101:stat.0 00010000:00010000:2.0:1787548734.359996:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548734.360023:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a228a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360181:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ec4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360197:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ec4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360211:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ec4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360229:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360236:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360243:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360456:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360466:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360473:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548734.360516:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787548734.360521:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548734.360549:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360563:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360573:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ec4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360580:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ec4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360588:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ec4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360665:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21edc00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548734.360670:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ec4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360678:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ec4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360912:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:2.0:1787548734.360917:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548734.360923:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ec4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360931:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ec4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360948:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360954:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360960:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360966:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ede00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548734.360969:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360976:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360984:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fec87ceba00) 00010000:00010000:2.0:1787548734.360987:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548734.360990:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.360996:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.361050:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424ec46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a228a expref: 42 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.361067:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a228a expref: 41 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.361075:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548734.361077:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548734.361079:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ed200, rc 0) 00000100:00100000:2.0:1787548734.361217:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+41:10388:x1874380416123776:12345-192.168.206.13@tcp:101:stat.0 Request processed in 1257us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548734.361226:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 55 00000100:00100000:1.0:1787548734.457255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548734.457381:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416124032 00000100:00100000:3.0:1787548734.457394:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416124032 00000100:00100000:3.0:1787548734.457470:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 56 00000100:00100000:3.0:1787548734.457500:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+41:10398:x1874380416124032:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548734.457526:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548734.457552:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ec62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2291 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548734.457726:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787548734.457897:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ec62 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2291 expref: 43 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.457915:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:3.0:1787548734.457919:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787548734.457925:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ec62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2291 expref: 43 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.457943:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92800, rc 0) 00000100:00100000:3.0:1787548734.458785:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+42:10398:x1874380416124032:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 1281us (1536us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787548734.458798:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 56 00000100:00100000:3.0:1787548734.461914:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548734.462025:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416124288 00000100:00100000:2.0:1787548734.462037:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416124288 00000100:00100000:2.0:1787548734.462112:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:2.0:1787548734.462124:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+42:10398:x1874380416124288:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:2.0:1787548734.462511:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+43:10398:x1874380416124288:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 388us (609us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787548734.462520:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:1.0:1787548734.520008:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548734.520215:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416124544 00000100:00100000:0.0:1787548734.520228:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416124544 00000100:00100000:0.0:1787548734.520313:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 57 00000100:00100000:0.0:1787548734.520325:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+43:10404:x1874380416124544:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:0.0:1787548734.520358:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548734.520387:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ec70 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2298 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.520519:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.520558:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a228a expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.520568:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.520619:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a228a expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.520636:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a228a expref: 44 pid: 5856 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548734.520652:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcef6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431879296:192.168.206.13@tcp:104: 00000100:00100000:0.0:1787548734.520786:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548734.524599:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548734.524756:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416124672 00000100:00100000:3.0:1787548734.524768:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416124672 00010000:00010000:3.0:1787548734.524825:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec5b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a228a expref: 45 pid: 5856 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548734.524878:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 40 00000100:00100000:3.0:1787548734.524890:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+45:2351:x1874380416124672:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548734.524910:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548734.524937:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec5b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a228a expref: 45 pid: 5856 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.524953:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a228a expref: 45 pid: 5856 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.524985:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:3.0:1787548734.524991:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.525003:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.525011:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.525034:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548734.525119:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+45:2351:x1874380416124672:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 231us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548734.525127:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 40 00010000:00010000:0.0:1787548734.526359:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a228a expref: 44 pid: 5856 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548734.526386:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcef6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431879296:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548734.526412:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.526423:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.526428:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548734.526455:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787548734.526684:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ec70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2298 expref: 45 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.526713:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2298 expref: 44 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.526723:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:0.0:1787548734.526726:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787548734.527446:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150800, rc 0) 00000100:00100000:0.0:1787548734.527533:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+44:10404:x1874380416124544:12345-192.168.206.13@tcp:101:bash.0 Request processed in 7207us (7538us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787548734.527543:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 57 00000100:00100000:1.0:1787548734.529941:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548734.530068:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416124928 00000100:00100000:2.0:1787548734.530080:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416124928 00000100:00100000:2.0:1787548734.530219:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 58 00000100:00100000:2.0:1787548734.530232:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+44:10404:x1874380416124928:12345-192.168.206.13@tcp:36:bash.0 00010000:00010000:2.0:1787548734.530651:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.530702:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.530717:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787548734.531040:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787548734.531077:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000861019ac reply state 000000001ee548ba transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548734.531088:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787548734.531238:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+47:10404:x1874380416124928:12345-192.168.206.13@tcp:36:bash.0 Request processed in 1007us (1309us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787548734.531247:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 58 00000020:00080000:2.0:1787548734.531254:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787548734.535392:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.535416:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.535424:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.535431:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ede00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548734.535436:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.535446:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.535490:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548734.535493:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548734.535498:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.535504:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ec85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548734.536733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548734.537173:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416125056 00000100:00100000:2.0:1787548734.537186:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416125056 00000100:00100000:2.0:1787548734.537249:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 59 00000100:00100000:2.0:1787548734.537261:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+46:10404:x1874380416125056:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:2.0:1787548734.537294:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548734.537317:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ec8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a229f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.537423:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.537441:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2298 expref: 47 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.537457:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec93 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.537502:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2298 expref: 47 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.537518:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2298 expref: 47 pid: 5854 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548734.537553:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1874380431879424:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548734.537764:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787548734.540266:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1874380431879424:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548734.540314:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548734.540473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548734.540809:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416125184 00000100:00100000:3.0:1787548734.540819:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416125184 00010000:00010000:3.0:1787548734.541044:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2298 expref: 48 pid: 5854 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548734.541088:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 41 00000100:00100000:3.0:1787548734.541099:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+48:2351:x1874380416125184:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548734.541116:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548734.541125:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2298 expref: 48 pid: 5854 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.541191:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2298 expref: 48 pid: 5854 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.541223:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ec77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2298 expref: 48 pid: 5854 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.541249:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:3.0:1787548734.541255:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.541266:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.541283:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec93 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.541316:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548734.541398:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+47:2351:x1874380416125184:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 299us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548734.541406:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 41 00010000:00010000:2.0:1787548734.541478:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.541492:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548734.541561:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787548734.541566:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548734.541600:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.541636:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ec8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a229f expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.541654:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a229f expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.541661:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548734.541664:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548734.541667:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ed200, rc 0) 00000100:00100000:2.0:1787548734.541712:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+46:10404:x1874380416125056:12345-192.168.206.13@tcp:101:bash.0 Request processed in 4453us (4990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548734.541737:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 59 00000100:00100000:3.0:1787548734.545053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548734.545233:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416125440 00000100:00100000:2.0:1787548734.545247:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416125440 00000100:00100000:2.0:1787548734.545317:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 15 00000100:00100000:2.0:1787548734.545328:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca6f17850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+46:10404:x1874380416125440:12345-192.168.206.13@tcp:35:bash.0 00000100:00100000:2.0:1787548734.545707:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca6f17850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+47:10404:x1874380416125440:12345-192.168.206.13@tcp:35:bash.0 Request processed in 368us (653us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787548734.545716:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 15 00000100:00100000:1.0:1787548734.624808:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548734.625189:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416125696 00000100:00100000:3.0:1787548734.625205:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416125696 00000100:00100000:3.0:1787548734.625283:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 60 00000100:00100000:3.0:1787548734.625296:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+47:10414:x1874380416125696:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548734.625331:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548734.625368:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ec9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a22a6 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548734.625532:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787548734.625675:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ec9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22a6 expref: 49 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.625705:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:3.0:1787548734.625709:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787548734.625715:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ec9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22a6 expref: 49 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.625732:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92800, rc 0) 00000100:00100000:3.0:1787548734.625825:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+48:10414:x1874380416125696:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 531us (1031us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1787548734.626112:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 60 00000100:00100000:1.0:1787548734.631245:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548734.636597:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416125824 00000100:00100000:0.0:1787548734.636621:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416125824 00000100:00100000:0.0:1787548734.636720:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 61 00000100:00100000:0.0:1787548734.636732:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+48:10414:x1874380416125824:12345-192.168.206.13@tcp:34:lfs.0 00010000:00010000:0.0:1787548734.636853:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424eca8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.636874:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424eca8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.636888:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424eca8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.636906:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ecaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.636913:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ecaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637100:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ecaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637266:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ecb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637277:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ecb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637284:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ecb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787548734.637569:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ecb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637587:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424eca8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637594:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424eca8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637601:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424eca8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637607:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548734.637611:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424eca8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637620:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424eca8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637634:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:0.0:1787548734.637644:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548734.637650:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424eca8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637656:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424eca8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637672:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ecaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637678:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ecaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637685:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ecaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637690:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548734.637704:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ecaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637711:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ecaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637720:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8feca2cf6000) 00010000:00010000:0.0:1787548734.637722:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548734.637725:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ecaf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637731:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ecaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637747:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ecb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637769:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ecb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637775:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ecb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637781:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548734.637784:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ecb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637790:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ecb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637799:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:0.0:1787548734.637801:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548734.637805:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ecb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548734.637810:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ecb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548734.638429:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+48:10414:x1874380416125824:12345-192.168.206.13@tcp:34:lfs.0 Request processed in 1692us (8291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548734.638443:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 61 00000100:00100000:1.0:1787548734.646302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548734.647093:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416126080 00000100:00100000:3.0:1787548734.647108:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416126080 00000100:00100000:3.0:1787548734.647308:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:3.0:1787548734.647321:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+48:10414:x1874380416126080:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:3.0:1787548734.647677:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+49:10414:x1874380416126080:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 358us (1390us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787548734.647686:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:3.0:1787548734.708669:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548734.709164:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416126336 00000100:00100000:2.0:1787548734.709178:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416126336 00000100:00100000:2.0:1787548734.709252:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 62 00000100:00100000:2.0:1787548734.709264:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+49:10417:x1874380416126336:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548734.709297:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548734.709324:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ecbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a22ad expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.709421:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ecc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.709439:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ecc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.709453:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ecc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.709470:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eccb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.709496:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.709503:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.709676:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ecd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.709685:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ecd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.709692:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ecd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548734.709714:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787548734.710062:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ecc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710072:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ecc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710080:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ecc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710086:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ede00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548734.710091:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ecc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710100:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ecc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710193:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:2.0:1787548734.710197:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548734.710204:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ecc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710210:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424ecc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710228:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710235:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eccb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710240:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710245:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548734.710248:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710254:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eccb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710262:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fec87ceba00) 00010000:00010000:2.0:1787548734.710264:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548734.710267:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eccb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710273:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424eccb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710341:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21edc00/0xcb7c48919424ecbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22ad expref: 52 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710356:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ecd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22ad expref: 51 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.710364:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548734.710366:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548734.710369:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6c00, rc 0) 00000100:00100000:2.0:1787548734.710451:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:10417:x1874380416126336:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 1190us (1797us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787548734.710460:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 62 00000100:00100000:1.0:1787548734.718451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548734.718512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548734.718601:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416126592 00000100:00100000:2.0:1787548734.718614:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416126592 00000100:00100000:2.0:1787548734.718689:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 63 00000100:00100000:2.0:1787548734.718713:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:10417:x1874380416126592:12345-192.168.206.13@tcp:54:lfs.0 00010000:00010000:2.0:1787548734.718815:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ece0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.718837:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ece0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.718862:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ece0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.718897:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ece0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.718936:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ece0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.718944:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ece0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.718950:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548734.718955:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ece0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.718964:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ece0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.718980:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548734.718983:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787548734.718988:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ece0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.718994:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ece0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548734.719077:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:10417:x1874380416126592:12345-192.168.206.13@tcp:54:lfs.0 Request processed in 368us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548734.719084:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 63 00000100:00100000:3.0:1787548734.719381:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416126464 00000100:00100000:3.0:1787548734.719386:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416126464 00000100:00100000:3.0:1787548734.719440:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 4 00000100:00100000:3.0:1787548734.719449:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:2351:x1874380416126464:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548734.719474:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548734.719493:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ecd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22ad expref: 51 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548734.719508:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:3.0:1787548734.719511:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548734.719537:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+50:2351:x1874380416126464:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 90us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548734.719544:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 4 00000100:00100000:1.0:1787548734.733111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548734.733745:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416126848 00000100:00100000:2.0:1787548734.734212:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416126848 00000100:00100000:2.0:1787548734.734302:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 17 00000100:00100000:2.0:1787548734.734316:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+50:10417:x1874380416126848:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:2.0:1787548734.734658:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:10417:x1874380416126848:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 344us (1563us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787548734.734686:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 17 00010000:00010000:2.0:1787548734.917209:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548734.933122:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548734.933472:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416127104 00000100:00100000:2.0:1787548734.933486:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416127104 00000100:00100000:2.0:1787548734.933557:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 64 00000100:00100000:2.0:1787548734.933570:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:10435:x1874380416127104:12345-192.168.206.13@tcp:101:cat.0 00010000:00010000:2.0:1787548734.933615:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548734.933642:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ece7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a22b4 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.933785:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ecee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.933802:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ecee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.933815:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ecee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548734.933829:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787548734.934004:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ece7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22b4 expref: 54 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.934026:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ecee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22b4 expref: 53 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.934035:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548734.934038:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787548734.934061:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6000, rc 0) 00000100:00100000:2.0:1787548734.934484:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+53:10435:x1874380416127104:12345-192.168.206.13@tcp:101:cat.0 Request processed in 914us (1376us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787548734.934493:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 64 00000100:00100000:1.0:1787548734.976543:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548734.977656:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416127232 00000100:00100000:2.0:1787548734.977670:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416127232 00000100:00100000:2.0:1787548734.977762:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 65 00000100:00100000:2.0:1787548734.977774:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+53:10436:x1874380416127232:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548734.977814:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548734.977841:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ecfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a22bb expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.978297:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ed03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.978328:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ed03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.978342:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ed03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548734.978438:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787548734.978443:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548734.978466:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ed03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.978496:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ecfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22bb expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.978519:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ed03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22bb expref: 54 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548734.978546:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:2.0:1787548734.978549:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787548734.978553:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7600, rc 0) 00000100:00100000:2.0:1787548734.978646:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:10436:x1874380416127232:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 874us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548734.978653:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 65 00000100:00100000:0.0:1787548734.979673:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb42b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431879552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548734.979755:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548734.980310:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431879808:0@lo:400:kworker.0 00000100:00100000:3.0:1787548734.980362:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548734.980390:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787548734.980396:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431879936:0@lo:400:kworker.0 00000100:00100000:3.0:1787548734.980420:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787548734.980511:0:6723:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357857379737ns, next at 358857376422ns, rc = 0 00000100:00100000:3.0:1787548734.980544:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787548734.980567:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431880320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787548734.980860:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431879680:0@lo:400:kworker.0 00000100:00100000:0.0:1787548734.980955:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431880064:0@lo:400:kworker.0 00000100:00100000:1.0:1787548734.981145:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431879552 00000100:00100000:1.0:1787548734.981155:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431879552 00000100:00100000:1.0:1787548734.981222:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787548734.981233:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431879552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787548734.981274:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548734.981369:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548734.981405:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874380431880192:0@lo:400:kworker.0 00000100:00100000:2.0:1787548734.981431:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548734.981502:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431879808 00000100:00100000:2.0:1787548734.981507:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431879808 00000100:00100000:2.0:1787548734.981535:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431879936 00000100:00100000:2.0:1787548734.981537:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431879936 00000100:00100000:2.0:1787548734.981551:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431880192 00000100:00100000:2.0:1787548734.981553:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431880192 00000100:00100000:2.0:1787548734.981568:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787548734.981575:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431879808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548734.981631:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431879808:12345-0@lo:400:kworker.0 Request processed in 56us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548734.981638:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787548734.981657:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787548734.981663:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431879936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548734.981702:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431879936:12345-0@lo:400:kworker.0 Request processed in 29us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548734.981728:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787548734.981742:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787548734.981748:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874380431880192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548734.981800:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874380431880192:12345-0@lo:400:kworker.0 Request processed in 51us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548734.981806:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787548734.981844:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874380431880192:0@lo:400:kworker.0 00000100:00100000:2.0:1787548734.981878:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431879936:0@lo:400:kworker.0 00000100:00100000:2.0:1787548734.981888:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431879808:0@lo:400:kworker.0 00000100:00100000:2.0:1787548734.982352:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431879680 00000100:00100000:2.0:1787548734.982359:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431879680 00000100:00100000:2.0:1787548734.982390:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787548734.982398:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3314:x1874380431879680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548734.982443:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3314:x1874380431879680:12345-0@lo:400:kworker.0 Request processed in 46us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548734.982449:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787548734.982490:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431879680:0@lo:400:kworker.0 00000100:00100000:3.0:1787548734.983431:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548734.983814:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787548734.983824:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:3.0:1787548734.983844:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787548734.983850:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787548734.984124:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431880320 00000100:00100000:3.0:1787548734.984160:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431880320 00000100:00080000:3.0:1787548734.984210:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787548734.984279:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787548734.984294:0:11969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874380431880320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787548734.984330:0:11969:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548734.984396:0:11969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874380431880320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548734.984403:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787548734.984449:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431880320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548734.984893:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548734.985470:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431880064 00000100:00100000:3.0:1787548734.985478:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431880064 00000100:00100000:3.0:1787548734.985521:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787548734.985530:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874380431880064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548734.987390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548734.987460:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416127616 00000100:00100000:0.0:1787548734.987471:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416127616 00000100:00100000:0.0:1787548734.987526:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00100000:0.0:1787548734.987536:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:10436:x1874380416127616:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:3.0:1787548734.988276:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874380431880064:12345-0@lo:400:kworker.0 Request processed in 2742us (3380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548734.988288:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787548734.988606:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:10436:x1874380416127616:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 1068us (1227us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787548734.988615:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00100000:0.0:1787548734.988677:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431880064:0@lo:400:kworker.0 00000100:00100000:1.0:1787548734.993782:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431879552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12536us (14012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548734.993877:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787548734.994076:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb42b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431879552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548734.997066:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548734.997113:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416127744 00000100:00100000:1.0:1787548734.997123:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416127744 00000100:00100000:1.0:1787548734.997208:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 5 00000100:00100000:1.0:1787548734.997234:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:10436:x1874380416127744:12345-192.168.206.13@tcp:103:lfs.0 00010000:00010000:1.0:1787548734.997250:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787548734.997275:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424ec93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a229f expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548734.997298:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ecee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22b4 expref: 54 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548734.997311:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424eb9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2260 expref: 53 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548734.997323:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:1.0:1787548734.997333:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548734.997382:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+52:10436:x1874380416127744:12345-192.168.206.13@tcp:103:lfs.0 Request processed in 152us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548734.997390:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 5 00000100:00100000:2.0:1787548735.005314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548735.005357:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416127872 00000100:00100000:2.0:1787548735.005369:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416127872 00000100:00100000:2.0:1787548735.005436:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 66 00000100:00100000:2.0:1787548735.005448:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+52:10436:x1874380416127872:12345-192.168.206.13@tcp:58:lfs.0 00010000:00010000:2.0:1787548735.005605:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ed0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.005639:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ed0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.005655:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ed0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787548735.006887:0:8467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787548735.007899:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787548735.008241:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787548735.008471:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+52:10436:x1874380416127872:12345-192.168.206.13@tcp:58:lfs.0 Request processed in 3017us (3162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548735.008484:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 66 00000100:00100000:0.0:1787548735.028233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548735.028295:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416128000 00000100:00100000:0.0:1787548735.028308:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416128000 00000100:00100000:0.0:1787548735.028564:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 67 00000100:00100000:0.0:1787548735.028580:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+52:10438:x1874380416128000:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548735.028608:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548735.028634:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ed11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a22c2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.029223:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ed18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.029242:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ed18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.029256:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ed18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.029274:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ed1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.029299:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ed1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.029307:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ed1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.030311:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ed26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.030404:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ed26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.030416:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ed26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548735.030467:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787548735.030472:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548735.030494:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ed26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.030508:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ed26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.030519:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ed18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.030526:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ed18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.030533:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ed18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.031439:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548735.031449:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ed18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.031461:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ed18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.031480:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:0.0:1787548735.031483:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548735.031488:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ed18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.031495:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ed18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.031516:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ed1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.031522:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ed1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.031527:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ed1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.031534:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548735.031537:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ed1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.031543:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ed1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.031568:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8feca2cf6000) 00010000:00010000:0.0:1787548735.031571:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548735.031574:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ed1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.031580:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ed1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.031634:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ed11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22c2 expref: 54 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.031651:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ed26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22c2 expref: 53 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548735.031659:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:0.0:1787548735.031661:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787548735.031664:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150800, rc 0) 00000100:00100000:0.0:1787548735.031762:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+53:10438:x1874380416128000:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 3186us (3544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548735.031773:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 67 00000001:00080000:0.0:1787548735.113754:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000004:00080000:0.0:1787548735.113776:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787548735.113811:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fec900c5780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787548735.113817:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fec88423400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fec900c5240 00000020:00080000:0.0:1787548735.113820:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fec88423800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fecad53b400 00000001:00080000:0.0:1787548735.113853:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:0.0:1787548735.113960:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1787548735.114164:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:3.0:1787548735.114166:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787548735.114196:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431880448:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787548735.114289:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787548735.114301:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787548735.114562:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431880448 00000100:00100000:3.0:1787548735.114641:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431880448 00000100:00100000:3.0:1787548735.114868:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787548735.114880:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1874380431880448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787548735.114915:0:10297:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1787548735.115050:0:10297:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8bd43d, atime: 0x6a8bd43d, ctime: 0x6a8bd43d, blocks: 0x1 00010000:00010000:3.0:1787548735.115061:0:10297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424ed2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.115177:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1787548735.115196:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548735.115205:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424ed2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.115225:0:10297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424ed2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.115236:0:10297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424ed2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.115245:0:10297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424ed2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.115270:0:10297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787548735.115312:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548735.115322:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424ed2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548735.115334:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92800 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548735.115340:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424ed2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548735.115352:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424ed2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548735.115387:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424ed2d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548735.115395:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424ed2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548735.115417:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548735.115419:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548735.115421:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548735.116314:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1874380431880448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1430us (2019us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787548735.116327:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1787548735.116455:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fecbd061c00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787548735.116464:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431880448:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1787548735.759079:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787548735.759089:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787548735.759172:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787548735.759182:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787548735.760963:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb42b4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874380431880576:192.168.206.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787548735.763866:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865e5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787548735.775619:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb42b4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874380431880576:192.168.206.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787548735.778618:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548735.779816:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416128128 00000100:00100000:1.0:1787548735.779842:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416128128 00000100:00100000:1.0:1787548735.779914:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 1 00000100:00100000:1.0:1787548735.779926:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:10449:x1874380416128128:12345-192.168.206.13@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787548735.780036:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:10449:x1874380416128128:12345-192.168.206.13@tcp:900:lhsmtool_posix.0 Request processed in 111us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548735.780045:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 1 00000100:00100000:1.0:1787548735.790409:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548735.790571:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416128256 00000100:00100000:2.0:1787548735.790595:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416128256 00000100:00100000:2.0:1787548735.790676:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 68 00000100:00100000:2.0:1787548735.790699:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:10449:x1874380416128256:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787548735.790743:0:5855:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787548735.790897:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:10449:x1874380416128256:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 Request processed in 210us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548735.790905:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 68 00000100:00100000:1.0:1787548735.801900:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548735.802585:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416128384 00000100:00100000:3.0:1787548735.802601:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416128384 00000100:00100000:3.0:1787548735.802666:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 69 00000100:00100000:3.0:1787548735.802678:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:10449:x1874380416128384:12345-192.168.206.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787548735.802799:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ed34 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.802822:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ed34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.802840:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ed34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.806195:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ed3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.806218:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ed3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.806231:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ed3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.806268:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ed42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.806276:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ed42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.806283:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ed42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548735.806324:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787548735.806328:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548735.806339:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ed42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.806350:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ed34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.806356:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ed34 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.806364:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ed34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.807700:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548735.807706:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ed34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.807715:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ed34 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.807731:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8feca2d51a00) 00010000:00010000:3.0:1787548735.807733:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548735.807738:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ed34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.807744:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ed34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.807761:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ed3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.808060:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ed3b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.808067:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ed3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.808072:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548735.808076:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ed3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.808082:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ed3b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.808107:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8fec90d93b00) 00010000:00010000:3.0:1787548735.808109:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548735.808112:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ed3b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.808118:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ed3b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.808160:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ed42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.808166:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ed42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.808171:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ed42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.808176:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548735.808179:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ed42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.808185:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ed42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.808193:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:3.0:1787548735.808195:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548735.808198:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ed42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.808204:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ed42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548735.808315:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:10449:x1874380416128384:12345-192.168.206.13@tcp:34:lhsmtool_posix.0 Request processed in 5635us (6425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548735.808324:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 69 00000100:00100000:1.0:1787548735.811219:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548735.811461:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416128640 00000100:00100000:3.0:1787548735.811474:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416128640 00000100:00100000:3.0:1787548735.811554:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 70 00000100:00100000:3.0:1787548735.811567:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:10449:x1874380416128640:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787548735.811596:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548735.811621:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ed49 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a22c9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.811834:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ed50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.812556:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ed50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.812574:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ed50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548735.812592:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787548735.813004:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ed50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.813014:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ed50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.813021:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ed50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.813036:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548735.813041:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ed50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.813049:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ed50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.813064:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:3.0:1787548735.813068:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787548735.813073:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ed50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.813080:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ed50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.813162:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ed49 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22c9 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.813174:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8feca2d51a00) 00010000:00010000:3.0:1787548735.813176:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787548735.813180:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ed49 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22c9 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.813193:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93800, rc 0) 00000100:00100000:0.0:1787548735.813342:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:10449:x1874380416128640:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 1775us (2136us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787548735.813361:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 70 00000100:00100000:1.0:1787548735.828252:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548735.828370:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416128768 00000100:00100000:2.0:1787548735.828384:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416128768 00000100:00100000:2.0:1787548735.828474:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 71 00000100:00100000:2.0:1787548735.828486:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:10449:x1874380416128768:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787548735.828552:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787548735.828717:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:10449:x1874380416128768:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 Request processed in 233us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548735.828725:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 71 00000100:00100000:3.0:1787548735.833030:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548735.833890:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416129024 00000100:00100000:1.0:1787548735.833905:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416129024 00000100:00100000:1.0:1787548735.833984:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 72 00000100:00100000:1.0:1787548735.833996:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:10449:x1874380416129024:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787548735.834025:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548735.834030:0:8467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787548735.834065:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ed03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22bb expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548735.834093:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:1.0:1787548735.834099:0:8467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787548735.834117:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424ed5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a22d0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787548735.835020:0:8467:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787548735.835361:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ed65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548735.835379:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ed65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548735.835393:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ed65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548735.835464:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424ed5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22d0 expref: 15 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548735.835495:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ed65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22d0 expref: 14 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548735.835504:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8feca2d51100) 00010000:00010000:1.0:1787548735.835508:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787548735.835511:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22f000, rc 0) 00000100:00100000:1.0:1787548735.835605:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:10449:x1874380416129024:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 1610us (2590us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787548735.835615:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 72 00000100:00100000:1.0:1787548735.844025:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548735.844220:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416129280 00000100:00100000:2.0:1787548735.844234:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416129280 00000100:00100000:3.0:1787548735.844562:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 73 00000100:00100000:3.0:1787548735.844573:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:10449:x1874380416129280:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787548735.844781:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548735.844824:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ed65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22d0 expref: 14 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.844855:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8feca2d51100) 00010000:00010000:3.0:1787548735.844868:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787548735.844896:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ed73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.844912:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ed73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.844925:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ed73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.844942:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ed7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x65edba3e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.844949:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ed7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x65edba3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.844956:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ed7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x65edba3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.845313:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ed73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.845323:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ed73 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.845330:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ed73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.845336:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548735.845916:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ed73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.845928:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ed73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.845941:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:3.0:1787548735.845944:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548735.845948:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ed73 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.845955:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ed73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.845969:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ed7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x65edba3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.845976:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ed7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x65edba3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.845982:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ed7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x65edba3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.845988:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548735.845991:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ed7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x65edba3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.845997:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ed7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x65edba3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.846004:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x65edba3e (ffff8fec90d93b00) 00010000:00010000:3.0:1787548735.846006:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548735.846016:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ed7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x65edba3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548735.846022:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424ed7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x65edba3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548735.846286:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:10449:x1874380416129280:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 1708us (2270us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787548735.846296:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 73 00000100:00100000:0.0:1787548735.849770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548735.849944:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416129408 00000100:00100000:2.0:1787548735.849958:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416129408 00000100:00100000:2.0:1787548735.850059:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 74 00000100:00100000:2.0:1787548735.850071:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:10449:x1874380416129408:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787548735.850097:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548735.850124:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ed81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a22d7 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.850193:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ed88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.850209:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ed88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.850221:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ed88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.850332:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ed81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22d7 expref: 15 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.850362:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ed88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22d7 expref: 14 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.850387:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:2.0:1787548735.850390:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787548735.850394:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6000, rc 0) 00000100:00100000:2.0:1787548735.850468:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:10449:x1874380416129408:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 399us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548735.850476:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 74 00000100:00100000:0.0:1787548735.854484:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548735.854949:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416129664 00000100:00100000:2.0:1787548735.854963:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416129664 00000100:00100000:2.0:1787548735.855031:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 75 00000100:00100000:2.0:1787548735.855043:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:10449:x1874380416129664:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787548735.855177:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ed8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.855198:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ed8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.855212:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ed8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787548735.855872:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1787548735.855887:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358732755354ns, next at 359732752197ns, rc = 0 00000004:00010000:0.0:1787548735.856003:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a377cce reply state 00000000f6f8b75e transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ed8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548735.856015:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787548735.856185:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:10449:x1874380416129664:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 1141us (1711us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787548735.856194:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 75 00010000:00010000:2.0:1787548735.859722:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ed8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.859745:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ed8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.859754:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ed8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.859760:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548735.859776:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ed8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.859785:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ed8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.859808:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:2.0:1787548735.859812:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787548735.859817:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ed8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.859824:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ed8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548735.864737:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548735.864920:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416129792 00000100:00100000:2.0:1787548735.864934:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416129792 00000100:00100000:2.0:1787548735.865010:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 76 00000100:00100000:2.0:1787548735.865022:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:10449:x1874380416129792:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787548735.865053:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548735.865080:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ed96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a22de expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.865187:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ed96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22de expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.865205:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ed96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22de expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548735.865230:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:2.0:1787548735.865234:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787548735.865246:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7e00, rc 0) 00000100:00100000:2.0:1787548735.865324:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:10449:x1874380416129792:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 304us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548735.865332:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 76 00000100:00100000:1.0:1787548735.886635:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548735.888872:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416129920 00000100:00100000:2.0:1787548735.888892:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416129920 00000100:00100000:2.0:1787548735.888967:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 25 00000100:00100000:2.0:1787548735.888979:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1874380416129920:12345-192.168.206.13@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787548735.889020:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:2.0:1787548735.889076:0:6691:0:(genops.c:1385:class_connect()) connect: client e4505aba-b49a-4ae4-be2d-9f5ba513779c, cookie 0xcb7c48919424ed9d 00002000:00100000:2.0:1787548735.889095:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e4505aba-b49a-4ae4-be2d-9f5ba513779c/ffff8feb81f25000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787548735.889110:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787548735.889496:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787548735.889727:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8fec8381a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787548735.889829:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2350:x1874380416129920:12345-192.168.206.13@tcp:8:lhsmtool_posix.0 Request processed in 850us (3208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548735.889840:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 25 00000100:00100000:0.0:1787548735.893496:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548735.894657:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416130048 00000100:00100000:3.0:1787548735.894679:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416130048 00000100:00100000:3.0:1787548735.894789:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 26 00000100:00100000:3.0:1787548735.894803:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:0:x1874380416130048:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787548735.895184:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787548735.949457:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548736.014284:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:0:x1874380416130048:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 Request processed in 119468us (120785us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787548736.014301:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 26 00000001:00100000:3.0:1787548736.014344:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000001:00080000:3.0:1787548736.014362:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000040:00080000:1.0:1787548736.016317:0:12010:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787548736.016325:0:12010:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787548736.016361:0:12010:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787548736.016563:0:12010:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787548736.020250:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548736.020720:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416130304 00000100:00100000:1.0:1787548736.020734:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416130304 00000100:00100000:1.0:1787548736.020812:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 19 00000100:00100000:1.0:1787548736.020825:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:10449:x1874380416130304:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787548736.021118:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:10449:x1874380416130304:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 Request processed in 295us (1877us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787548736.021126:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 19 00000100:00080000:0.0:1787548736.021829:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548736.026150:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548736.026989:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416130560 00000100:00100000:1.0:1787548736.027005:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416130560 00000100:00100000:1.0:1787548736.027089:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 77 00000100:00100000:1.0:1787548736.027101:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:10449:x1874380416130560:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787548736.029166:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:10449:x1874380416130560:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 2053us (3038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548736.029182:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 77 00000100:00100000:1.0:1787548736.034977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548736.035076:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416130688 00000100:00100000:2.0:1787548736.035088:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416130688 00000100:00100000:2.0:1787548736.035430:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 78 00000100:00100000:2.0:1787548736.035444:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:10449:x1874380416130688:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787548736.035472:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548736.035498:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424eda4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a22e5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.035601:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424edab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.035634:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424edab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.035648:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424edab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548736.035708:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548736.035732:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424edab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.035763:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424eda4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22e5 expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.035784:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424edab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22e5 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.035794:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:2.0:1787548736.035797:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787548736.035801:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6c00, rc 0) 00000100:00100000:2.0:1787548736.036108:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:10449:x1874380416130688:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 666us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548736.036117:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 78 00000100:00100000:2.0:1787548736.046009:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548736.046566:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416130816 00000100:00100000:3.0:1787548736.046580:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416130816 00000100:00100000:3.0:1787548736.046977:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 27 00000100:00100000:3.0:1787548736.046989:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2354:x1874380416130816:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787548736.047011:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548736.047039:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000594d3b2b/0xcb7c48919424edb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a22ec expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787548736.047090:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8bd440, blocks: 0x1 00010000:00010000:3.0:1787548736.047113:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1787548736.047118:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548736.047151:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000594d3b2b/0xcb7c48919424edb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22ec expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.047176:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000594d3b2b/0xcb7c48919424edb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22ec expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.047193:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93800, rc 0) 00000100:00100000:3.0:1787548736.049683:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2354:x1874380416130816:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 1736us (2726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548736.049710:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 27 00000100:00100000:1.0:1787548736.063436:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548736.063552:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416131072 00000100:00100000:0.0:1787548736.063565:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416131072 00000100:00100000:0.0:1787548736.063634:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 79 00000100:00100000:0.0:1787548736.063647:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:10449:x1874380416131072:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787548736.063793:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:10449:x1874380416131072:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 148us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548736.063801:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 79 00000100:00100000:3.0:1787548736.070781:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548736.070828:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416131200 00000100:00100000:3.0:1787548736.070839:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416131200 00000100:00100000:3.0:1787548736.070902:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 28 00000100:00100000:3.0:1787548736.070913:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:10449:x1874380416131200:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787548736.070937:0:10297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548736.070960:0:10297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee960437/0xcb7c48919424edb9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a22f3 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.071002:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000594d3b2b/0xcb7c48919424edb2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22ec expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.071028:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548736.071033:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548736.071040:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee960437/0xcb7c48919424edb9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22f3 expref: 7 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.071085:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000594d3b2b/0xcb7c48919424edb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22ec expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.071100:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000594d3b2b/0xcb7c48919424edb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22ec expref: 7 pid: 6691 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548736.071122:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8829a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10297:1874380431880704:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548736.071245:0:10297:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb5480 going to sleep for 11 seconds 00000100:00100000:3.0:1787548736.073407:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8829a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10297:1874380431880704:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548736.073455:0:10297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee960437/0xcb7c48919424edb9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22f3 expref: 7 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.073481:0:10297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93200, rc 0) 00000100:00100000:3.0:1787548736.073548:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:10449:x1874380416131200:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 2635us (2780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548736.073558:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 28 00000100:00100000:2.0:1787548736.076113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548736.076280:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416131328 00000100:00100000:3.0:1787548736.076292:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416131328 00010000:00010000:3.0:1787548736.076341:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000594d3b2b/0xcb7c48919424edb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22ec expref: 7 pid: 6691 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548736.076569:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 42 00000100:00100000:3.0:1787548736.076581:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2351:x1874380416131328:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548736.076598:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548736.076627:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000594d3b2b/0xcb7c48919424edb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22ec expref: 7 pid: 6691 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.076644:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000594d3b2b/0xcb7c48919424edb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22ec expref: 7 pid: 6691 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.076672:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000594d3b2b/0xcb7c48919424edb2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22ec expref: 7 pid: 6691 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.076700:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548736.076706:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548736.076715:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee960437/0xcb7c48919424edb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22f3 expref: 6 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.076727:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee960437/0xcb7c48919424edb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22f3 expref: 6 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.076773:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee960437/0xcb7c48919424edb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22f3 expref: 6 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548736.076792:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8829a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5840:1874380431880832:192.168.206.13@tcp:105: 00000100:00100000:3.0:1787548736.076914:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb5480 going to sleep for 11 seconds 00000100:00100000:3.0:1787548736.082514:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8829a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5840:1874380431880832:192.168.206.13@tcp:105: 00010000:00010000:3.0:1787548736.082553:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548736.082643:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416131328:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 6062us (6542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548736.082656:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 42 00000100:00100000:2.0:1787548736.082715:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548736.083017:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416131456 00000100:00100000:1.0:1787548736.083027:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416131456 00002000:00100000:1.0:1787548736.083081:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8feca71da300 x1874380416131456/t0(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:177/0 lens 504/0 e 0 to 0 dl 1787548747 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787548736.083093:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8feca71da300 with x1874380416131456 ext(0->8) 00002000:00010000:1.0:1787548736.083098:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8feca71da300 00000100:00100000:1.0:1787548736.083123:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 0 00000100:00100000:1.0:1787548736.083185:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416131456:12345-192.168.206.13@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787548736.084381:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2352:x1874380416131456:12345-192.168.206.13@tcp:4:lhsmtool_posix.0 Request processed in 1242us (1661us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787548736.084395:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 0 00002000:00100000:1.0:1787548736.084409:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8feca71da300 x1874380416131456/t4294967302(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:177/0 lens 504/448 e 0 to 0 dl 1787548747 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787548736.084419:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8feca71da300 with x1874380416131456 ext(0->8) 00002000:00010000:1.0:1787548736.084426:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8feca71da300 00000100:00100000:2.0:1787548736.088027:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548736.088168:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416131584 00000100:00100000:1.0:1787548736.088181:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416131584 00000100:00100000:1.0:1787548736.088246:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 80 00000100:00100000:1.0:1787548736.088266:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:10449:x1874380416131584:12345-192.168.206.13@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787548736.143414:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000100:00100000:3.0:1787548736.143756:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:10449:x1874380416131584:12345-192.168.206.13@tcp:44:lhsmtool_posix.0 Request processed in 55483us (55735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548736.143769:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 80 00000004:00080000:0.0:1787548736.144279:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:0.0:1787548736.144321:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1787548736.144333:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787548736.144361:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787548736.144373:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787548736.144560:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8829a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431880960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787548736.144699:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548736.145198:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431880960 00000100:00100000:3.0:1787548736.145209:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431880960 00000100:00100000:3.0:1787548736.145322:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787548736.145333:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431880960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787548736.145539:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787548736.145543:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787548736 00002000:00010000:3.0:1787548736.145545:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787548736.145547:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787548736 -> 1787548736 00002000:00010000:3.0:1787548736.145550:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:2.0:1787548736.149222:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787548736.149394:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874380431880960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4054us (4696us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787548736.149411:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1787548736.149470:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fec8829a680/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787548736.149479:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8829a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431880960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787548736.150368:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548736.150474:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416131712 00000100:00100000:3.0:1787548736.150484:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416131712 00000100:00100000:3.0:1787548736.150648:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 30 00000100:00100000:3.0:1787548736.150663:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2351:x1874380416131712:12345-192.168.206.13@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787548736.211449:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1787548736.211774:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1787548736.212184:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416131712:12345-192.168.206.13@tcp:16:lhsmtool_posix.0 Request processed in 61516us (61815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548736.212214:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 30 00000100:00100000:3.0:1787548736.219926:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548736.220077:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416131968 00000100:00100000:0.0:1787548736.220092:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416131968 00000100:00100000:0.0:1787548736.220190:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 81 00000100:00100000:0.0:1787548736.220202:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec88298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:10449:x1874380416131968:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787548736.220277:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548736.220320:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424edab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22e5 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548736.220345:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:0.0:1787548736.220355:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787548736.220395:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424edc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548736.220412:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424edc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548736.220424:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424edc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787548736.220815:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005994f972 reply state 00000000519e7212 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424edc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548736.220836:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787548736.221098:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec88298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:10449:x1874380416131968:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 769us (1058us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787548736.221108:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 81 00000100:00100000:3.0:1787548736.225666:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00010000:00010000:2.0:1787548736.225964:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424edc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.225981:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424edc0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.225990:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424edc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.225996:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548736.226003:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424edc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.226012:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424edc0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.226035:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:2.0:1787548736.226038:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548736.226044:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424edc0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.226050:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424edc0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548736.226103:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416132096 00000100:00100000:0.0:1787548736.226117:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416132096 00000100:00100000:0.0:1787548736.226229:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 31 00000100:00100000:0.0:1787548736.226244:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416132096:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787548736.227764:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787548736.227775:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787548736 -> 1787548735 00002000:00010000:0.0:1787548736.227778:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787548733 00002000:00010000:0.0:1787548736.227781:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787548736 -> 1787548735 00002000:00010000:0.0:1787548736.227784:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787548736.227876:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2351:x1874380416132096:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 Request processed in 1631us (2221us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787548736.227888:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 31 00000100:00100000:1.0:1787548736.236369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548736.236440:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416132352 00000100:00100000:2.0:1787548736.236454:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416132352 00000100:00100000:2.0:1787548736.236544:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 82 00000100:00100000:2.0:1787548736.236557:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:10449:x1874380416132352:12345-192.168.206.13@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787548736.236668:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.236717:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ed88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22d7 expref: 13 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.236728:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.236775:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ed88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22d7 expref: 13 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.236791:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ed88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22d7 expref: 13 pid: 8467 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548736.236813:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71db480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1874380431881088:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548736.237277:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787548736.241295:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548736.241411:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416132480 00000100:00100000:1.0:1787548736.241424:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416132480 00010000:00010000:1.0:1787548736.241496:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ed88 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22d7 expref: 14 pid: 8467 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548736.241544:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 43 00000100:00100000:1.0:1787548736.241557:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:2351:x1874380416132480:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548736.241577:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548736.241586:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ed88 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22d7 expref: 14 pid: 8467 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.241602:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ed88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22d7 expref: 14 pid: 8467 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.241631:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:1.0:1787548736.241637:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.241649:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.241658:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.241681:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548736.241787:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:2351:x1874380416132480:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 232us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548736.241795:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 43 00010000:00010000:2.0:1787548736.241803:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424ed88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22d7 expref: 14 pid: 8467 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548736.241822:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71db480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1874380431881088:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548736.243194:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.243301:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.243310:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.243418:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.243427:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.243434:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.243441:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548736.243447:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.243455:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.243476:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:3.0:1787548736.243479:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787548736.243484:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.243490:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424edc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548736.243797:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:10449:x1874380416132352:12345-192.168.206.13@tcp:55:lhsmtool_posix.0 Request processed in 7234us (7435us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787548736.243828:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 82 00000100:00100000:3.0:1787548736.247630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548736.247716:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416132608 00000100:00100000:1.0:1787548736.247730:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416132608 00000100:00100000:1.0:1787548736.247805:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 32 00000100:00100000:1.0:1787548736.247817:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2352:x1874380416132608:12345-192.168.206.13@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787548736.247885:0:10297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424edce lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.247910:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee960437/0xcb7c48919424edb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22f3 expref: 7 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.247920:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787548736.247925:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787548736.247930:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424edce lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.247986:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee960437/0xcb7c48919424edb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22f3 expref: 7 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.248004:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee960437/0xcb7c48919424edb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22f3 expref: 7 pid: 10297 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548736.248025:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb42b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10297:1874380431881216:192.168.206.13@tcp:104: 00000100:00100000:1.0:1787548736.248766:0:10297:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec87e5c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787548736.252747:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548736.253252:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416132736 00000100:00100000:0.0:1787548736.253265:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416132736 00010000:00010000:0.0:1787548736.253319:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee960437/0xcb7c48919424edb9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22f3 expref: 8 pid: 10297 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548736.253369:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 44 00000100:00100000:0.0:1787548736.253381:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2352:x1874380416132736:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548736.253399:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548736.253428:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee960437/0xcb7c48919424edb9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22f3 expref: 8 pid: 10297 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548736.253458:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee960437/0xcb7c48919424edb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22f3 expref: 8 pid: 10297 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548736.253603:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787548736.253609:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787548736.253616:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424edce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548736.253629:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424edce lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548736.253653:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787548736.253672:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee960437/0xcb7c48919424edb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22f3 expref: 8 pid: 10297 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548736.253701:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb42b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10297:1874380431881216:192.168.206.13@tcp:104: 00000100:00100000:0.0:1787548736.253740:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2352:x1874380416132736:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 357us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548736.253749:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 44 00010000:00010000:1.0:1787548736.254398:0:10297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424edce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.254416:0:10297:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424edce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.254425:0:10297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424edce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.254458:0:10297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424edce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.254575:0:10297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424edce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.254584:0:10297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424edce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.254592:0:10297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e800 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548736.254598:0:10297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424edce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.254625:0:10297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424edce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.254642:0:10297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424edce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.254650:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424edce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548736.254860:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416132608:12345-192.168.206.13@tcp:1:lhsmtool_posix.0 Request processed in 7041us (7240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548736.254875:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 32 00000100:00100000:0.0:1787548736.257436:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548736.257606:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416132992 00000100:00100000:3.0:1787548736.257617:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416132992 00000100:00100000:3.0:1787548736.257739:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 83 00000100:00100000:3.0:1787548736.257753:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:10449:x1874380416132992:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787548736.257865:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.257886:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.257898:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.258391:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.258406:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ed96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22de expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.258415:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.258459:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ed96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22de expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.258477:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ed96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22de expref: 13 pid: 5855 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548736.258503:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431881344:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548736.258699:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865e5180 going to sleep for 11 seconds 00000100:00100000:3.0:1787548736.262095:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431881344:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548736.262095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548736.262187:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416133120 00000100:00100000:1.0:1787548736.262196:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416133120 00010000:00010000:1.0:1787548736.262246:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ed96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22de expref: 14 pid: 5855 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548736.262294:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 45 00000100:00100000:1.0:1787548736.262305:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:2351:x1874380416133120:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548736.262323:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548736.262331:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ed96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22de expref: 14 pid: 5855 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.262344:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ed96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22de expref: 14 pid: 5855 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.262393:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ed96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22de expref: 14 pid: 5855 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.262414:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:1.0:1787548736.262420:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.262431:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.262439:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.262460:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548736.262593:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:2351:x1874380416133120:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 282us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548736.262602:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 45 00010000:00010000:3.0:1787548736.262820:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.262832:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.262839:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787548736.263088:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1787548736.263273:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1787548736.263342:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1787548736.263810:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5854:1874380431881472:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787548736.263885:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548736.263925:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865e5300 going to sleep for 11 seconds 00000100:00100000:0.0:1787548736.263949:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431881472 00000100:00100000:0.0:1787548736.263957:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431881472 00000100:00100000:0.0:1787548736.264115:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787548736.264127:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1874380431881472:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787548736.264253:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1874380431881472:12345-0@lo:1000:mdt00_000.0 Request processed in 128us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548736.264262:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787548736.264330:0:5854:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787548736.264337:0:5854:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fec8829a680, transno 4294967303 00000100:00100000:3.0:1787548736.264354:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5854:1874380431881472:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787548736.265165:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787548736.265243:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5854:1874380431881600:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787548736.265292:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548736.265320:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865e5180 going to sleep for 11 seconds 00000100:00100000:0.0:1787548736.265450:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431881600 00000100:00100000:0.0:1787548736.265457:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431881600 00000100:00100000:0.0:1787548736.265600:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787548736.265619:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1874380431881600:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787548736.265861:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5854:x1874380431881600:12345-0@lo:1000:mdt00_000.0 Request processed in 243us (568us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787548736.265869:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787548736.265939:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5854:1874380431881600:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787548736.265993:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266004:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266013:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266019:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548736.266025:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266034:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266054:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:3.0:1787548736.266057:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787548736.266062:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266069:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eddc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266113:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ed0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266120:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ed0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266127:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ed0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266177:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548736.266181:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ed0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266187:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ed0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266197:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:3.0:1787548736.266200:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787548736.266203:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ed0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266210:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ed0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266235:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266251:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ed26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22c2 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266260:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266300:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ed26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22c2 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.266326:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ed26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22c2 expref: 16 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548736.266360:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcef9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431881728:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548736.266432:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865e5180 going to sleep for 11 seconds 00000100:00100000:2.0:1787548736.272996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548736.273381:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcef9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431881728:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548736.273422:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548736.273665:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416133248 00000100:00100000:0.0:1787548736.273675:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416133248 00010000:00010000:0.0:1787548736.273734:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ed26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22c2 expref: 17 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548736.274318:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 46 00000100:00100000:0.0:1787548736.274336:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:2351:x1874380416133248:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548736.274483:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548736.274493:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ed26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22c2 expref: 17 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548736.274578:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ed26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22c2 expref: 17 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548736.274607:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ed26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22c2 expref: 17 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548736.274627:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:0.0:1787548736.274632:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548736.274645:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548736.274677:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.276501:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548736.276618:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:2351:x1874380416133248:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 2278us (3628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548736.276630:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 46 00010000:00010000:3.0:1787548736.277050:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.277063:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.277081:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.277089:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.277098:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.277105:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548736.277110:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.277119:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.278486:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:3.0:1787548736.278572:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548736.278580:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.278590:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ede3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.278611:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.278618:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edd5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.278625:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.278631:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548736.278635:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.278642:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edd5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.278652:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:3.0:1787548736.278655:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787548736.278658:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edd5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548736.278664:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787548736.281657:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787548736.281671:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787548736.281715:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787548736.281724:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787548736.282074:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:10449:x1874380416132992:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 24206us (24649us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787548736.282092:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 83 00000020:00080000:1.0:1787548736.282101:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787548736.285501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548736.285721:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416133504 00000100:00100000:1.0:1787548736.285792:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416133504 00000100:00100000:1.0:1787548736.285986:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00100000:1.0:1787548736.286014:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:10449:x1874380416133504:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787548736.288647:0:5858:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787548736.288823:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1787548736.289043:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424edea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.289065:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424edea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.289080:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424edea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.289090:0:5858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424edea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.289098:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424edea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.289106:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424edea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548736.289237:0:5858:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787548736.289332:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548736.289576:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424edea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.289643:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22ea00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548736.289649:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424edea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.289658:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424edea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.289674:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8feca2d51400) 00010000:00010000:2.0:1787548736.289677:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787548736.289682:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424edea lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.289699:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424edea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548736.289718:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548736.289720:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548736.289722:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548736.289801:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:10449:x1874380416133504:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 Request processed in 3497us (4020us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787548736.289812:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 20 00000020:00080000:1.0:1787548736.289820:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787548736.966488:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787548737.284399:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787548737.284415:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787548737.284452:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787548737.284462:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787548737.991879:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787548738.076740:0:12065:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787548738.076749:0:12065:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787548738.076787:0:12065:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787548738.076795:0:12065:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1787548738.171191:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:3.0:1787548738.171211:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1787548738.171229:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1787548738.189757:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.189826:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416133760 00000100:00100000:3.0:1787548738.189838:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416133760 00000100:00100000:3.0:1787548738.189913:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 84 00000100:00100000:3.0:1787548738.189924:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:10468:x1874380416133760:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548738.189952:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548738.189973:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424edf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a22fa expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.190286:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edf8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.190301:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.190316:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548738.190328:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000100:00080000:2.0:1787548738.190571:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787548738.190937:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424edf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22fa expref: 20 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.190954:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22fa expref: 19 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.190963:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:3.0:1787548738.190966:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787548738.190969:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93800, rc 0) 00000100:00100000:3.0:1787548738.191065:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:10468:x1874380416133760:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 1143us (1316us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787548738.191083:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 84 00000100:00100000:0.0:1787548738.198888:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548738.198971:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416133888 00000100:00100000:1.0:1787548738.198980:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416133888 00000100:00100000:1.0:1787548738.199032:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 85 00000100:00100000:1.0:1787548738.199041:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:10468:x1874380416133888:12345-192.168.206.13@tcp:34:lfs.0 00010000:00010000:1.0:1787548738.199111:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424ee06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199156:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424ee06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199169:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424ee06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199184:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199191:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199198:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199606:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ee14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199615:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ee14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199622:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ee14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787548738.199658:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ee14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199689:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424ee06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199696:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424ee06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199703:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424ee06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199709:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22ea00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548738.199713:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424ee06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199720:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424ee06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199732:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:1.0:1787548738.199735:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548738.199739:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424ee06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199745:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424ee06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199755:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199761:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199766:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199777:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548738.199780:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199787:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199795:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8feca2d51600) 00010000:00010000:1.0:1787548738.199797:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548738.199800:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199806:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199820:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ee14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199825:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ee14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199831:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ee14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199836:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fa00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548738.199838:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ee14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199844:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ee14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199860:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2d51f00) 00010000:00010000:1.0:1787548738.199863:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548738.199866:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ee14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.199871:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424ee14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548738.199983:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:10468:x1874380416133888:12345-192.168.206.13@tcp:34:lfs.0 Request processed in 941us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548738.199990:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 85 00000100:00100000:3.0:1787548738.226670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548738.226754:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416134144 00000100:00100000:0.0:1787548738.226764:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416134144 00000100:00100000:0.0:1787548738.226821:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 86 00000100:00100000:0.0:1787548738.226832:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:10471:x1874380416134144:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548738.226852:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548738.226870:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ee1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2301 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.226946:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.226960:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.226972:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.226985:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.226992:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.226997:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227339:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227348:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227355:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548738.227365:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787548738.227771:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227779:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227786:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227791:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548738.227796:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227803:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227815:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:0.0:1787548738.227818:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548738.227823:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227838:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227849:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227855:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227861:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227866:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548738.227869:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227875:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227882:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548738.227885:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548738.227887:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227893:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227928:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ee1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2301 expref: 22 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227942:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2301 expref: 21 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.227955:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2cf6000) 00010000:00010000:0.0:1787548738.227957:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548738.227960:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150000, rc 0) 00000100:00100000:0.0:1787548738.228017:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:10471:x1874380416134144:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 1186us (1354us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787548738.228025:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 86 00000100:00100000:3.0:1787548738.241102:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.241157:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416134272 00000100:00100000:3.0:1787548738.241167:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416134272 00000100:00100000:3.0:1787548738.241216:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 87 00000100:00100000:3.0:1787548738.241225:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:10471:x1874380416134272:12345-192.168.206.13@tcp:54:lfs.0 00010000:00010000:3.0:1787548738.241287:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ee3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.241303:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ee3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.241314:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ee3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.241338:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ee3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.241344:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ee3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.241350:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ee3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.241356:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548738.241360:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ee3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.241367:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ee3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.241390:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2cf6000) 00010000:00010000:3.0:1787548738.241393:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787548738.241398:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ee3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.241404:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424ee3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548738.241468:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:10471:x1874380416134272:12345-192.168.206.13@tcp:54:lfs.0 Request processed in 244us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548738.241476:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 87 00000100:00100000:0.0:1787548738.257568:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.262193:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416134528 00000100:00100000:3.0:1787548738.262208:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416134528 00000100:00100000:3.0:1787548738.262264:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 21 00000100:00100000:3.0:1787548738.262274:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca6f14050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:10471:x1874380416134528:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:3.0:1787548738.262511:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca6f14050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+22:10471:x1874380416134528:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 238us (4963us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787548738.262520:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 21 00000100:00100000:3.0:1787548738.312174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548738.312257:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416134784 00000100:00100000:0.0:1787548738.312275:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416134784 00000100:00100000:0.0:1787548738.312351:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 88 00000100:00100000:0.0:1787548738.312362:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+22:9989:x1874380416134784:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:0.0:1787548738.312386:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548738.312406:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ee45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2308 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.312514:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.312530:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2301 expref: 23 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.312539:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.312575:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2301 expref: 23 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.312605:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2301 expref: 23 pid: 8467 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548738.312620:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcef4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1874380431881856:192.168.206.13@tcp:104: 00000100:00100000:0.0:1787548738.312726:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548738.317396:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcef4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1874380431881856:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548738.317409:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00010000:00010000:0.0:1787548738.317444:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548738.317532:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416134912 00000100:00100000:1.0:1787548738.317539:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416134912 00010000:00010000:1.0:1787548738.317581:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2301 expref: 24 pid: 8467 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548738.317622:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 47 00000100:00100000:1.0:1787548738.317632:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcefb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+24:2351:x1874380416134912:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548738.317749:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548738.317756:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2301 expref: 24 pid: 8467 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.317769:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2301 expref: 24 pid: 8467 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.317790:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2301 expref: 24 pid: 8467 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.317825:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2cf6000) 00010000:00010000:1.0:1787548738.317830:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.317839:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.317847:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.317876:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548738.317937:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcefb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+23:2351:x1874380416134912:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 306us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548738.317945:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 47 00010000:00010000:0.0:1787548738.318020:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.318028:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548738.318048:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787548738.318348:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ee45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2308 expref: 24 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.318369:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2308 expref: 23 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.318378:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2cf6000) 00010000:00010000:0.0:1787548738.318431:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787548738.318435:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150600, rc 0) 00000100:00100000:0.0:1787548738.318513:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+23:9989:x1874380416134784:12345-192.168.206.13@tcp:101:bash.0 Request processed in 6153us (6402us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787548738.318532:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 88 00000100:00100000:3.0:1787548738.334381:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548738.334521:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416135168 00000100:00100000:1.0:1787548738.334535:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416135168 00000100:00100000:1.0:1787548738.334601:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 89 00000100:00100000:1.0:1787548738.334611:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcefbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+23:9989:x1874380416135168:12345-192.168.206.13@tcp:36:bash.0 00010000:00010000:1.0:1787548738.334867:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.334884:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.334898:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787548738.334953:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1787548738.334980:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060a525ae reply state 00000000b3f6cae1 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548738.335003:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787548738.335053:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1787548738.335219:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcefbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+27:9989:x1874380416135168:12345-192.168.206.13@tcp:36:bash.0 Request processed in 608us (852us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1787548738.335226:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 89 00000020:00080000:1.0:1787548738.335231:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787548738.345120:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.345175:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.345184:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.345190:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548738.345195:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.345214:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.345231:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2cf6000) 00010000:00010000:0.0:1787548738.345233:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548738.345238:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.345244:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424ee5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548738.347632:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548738.347961:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416135296 00000100:00100000:0.0:1787548738.347976:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416135296 00000100:00100000:0.0:1787548738.348056:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 90 00000100:00100000:0.0:1787548738.348068:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+26:9989:x1874380416135296:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:0.0:1787548738.348102:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548738.348186:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ee61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a230f expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.348284:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ee61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a230f expref: 27 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.348302:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ee61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a230f expref: 27 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.348328:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2cf6000) 00010000:00010000:0.0:1787548738.348332:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787548738.348338:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150800, rc 0) 00000100:00100000:0.0:1787548738.348424:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+27:9989:x1874380416135296:12345-192.168.206.13@tcp:101:bash.0 Request processed in 358us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548738.348432:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 90 00000100:00100000:2.0:1787548738.354688:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.354835:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416135424 00000100:00100000:3.0:1787548738.354850:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416135424 00000100:00100000:3.0:1787548738.354944:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 33 00000100:00100000:3.0:1787548738.354957:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:9989:x1874380416135424:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:3.0:1787548738.354981:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548738.355026:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074729d12/0xcb7c48919424ee68 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2316 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787548738.355063:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8bd43f, atime: 0x6a8bd43d, ctime: 0x6a8bd43f, blocks: 0xb 00010000:00010000:3.0:1787548738.355094:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1787548738.355100:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548738.355110:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074729d12/0xcb7c48919424ee68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2316 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.355190:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074729d12/0xcb7c48919424ee68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2316 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.355207:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92c00, rc 0) 00000100:00080000:2.0:1787548738.355330:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787548738.355578:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:9989:x1874380416135424:12345-192.168.206.13@tcp:101:bash.0 Request processed in 623us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548738.355587:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 33 00000100:00100000:2.0:1787548738.359212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.359419:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416135552 00000100:00100000:3.0:1787548738.359432:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416135552 00002000:00010000:3.0:1787548738.359486:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787548738.359492:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fecad6e1c00 with x1874380416135552 ext(0->18446744073709551615) 00002000:00010000:3.0:1787548738.359507:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fecad6e1c00. 00000100:00100000:3.0:1787548738.359548:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 1 00000100:00100000:3.0:1787548738.359560:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2352:x1874380416135552:12345-192.168.206.13@tcp:10:bash.0 00002000:00010000:3.0:1787548738.360206:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787548738.360212:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787548735 -> 1787548739 00002000:00010000:3.0:1787548738.360215:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787548733 -> 1787548733 00002000:00010000:3.0:1787548738.360302:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787548735 -> 1787548739 00002000:00010000:3.0:1787548738.360305:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787548738.360382:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2352:x1874380416135552:12345-192.168.206.13@tcp:10:bash.0 Request processed in 823us (1182us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787548738.360391:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 1 00002000:00010000:3.0:1787548738.360395:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787548738.360399:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fecad6e1c00 with x1874380416135552 ext(0->18446744073709551615) 00002000:00010000:3.0:1787548738.360405:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fecad6e1c00. 00000100:00100000:0.0:1787548738.453770:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.454035:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416135680 00000100:00100000:3.0:1787548738.454047:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416135680 00000100:00100000:3.0:1787548738.454246:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 91 00000100:00100000:3.0:1787548738.454259:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+27:10485:x1874380416135680:12345-192.168.206.13@tcp:34:lfs.0 00010000:00010000:3.0:1787548738.454366:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ee6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.454390:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ee6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.454405:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ee6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.454423:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ee76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.454431:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ee76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.454438:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ee76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.454850:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ee7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.454861:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ee7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.454884:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ee7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787548738.454937:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ee7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.454951:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ee6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.454958:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ee6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.454966:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ee6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.454972:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548738.454977:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ee6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.454985:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ee6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455003:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:3.0:1787548738.455007:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548738.455012:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ee6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455027:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ee6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455046:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ee76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455052:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ee76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455058:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ee76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455063:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548738.455067:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ee76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455074:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ee76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455081:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fec90d93400) 00010000:00010000:3.0:1787548738.455084:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548738.455086:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ee76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455091:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424ee76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455109:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ee7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455114:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ee7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455186:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ee7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455193:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548738.455196:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ee7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455203:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ee7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455212:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2cf6000) 00010000:00010000:3.0:1787548738.455214:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548738.455217:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ee7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.455222:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424ee7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548738.455354:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+27:10485:x1874380416135680:12345-192.168.206.13@tcp:34:lfs.0 Request processed in 1093us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548738.455365:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 91 00000100:00100000:0.0:1787548738.497636:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.497775:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416135936 00000100:00100000:3.0:1787548738.497788:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416135936 00000100:00100000:0.0:1787548738.498022:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 92 00000100:00100000:0.0:1787548738.498038:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+27:10488:x1874380416135936:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548738.498073:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548738.498106:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424ee84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a231d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.498244:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.498261:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.498303:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.498323:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.498331:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.498338:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499278:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ee99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499296:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ee99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499306:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ee99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548738.499320:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787548738.499446:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499454:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499461:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499468:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548738.499482:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499491:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499505:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:0.0:1787548738.499509:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548738.499515:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499522:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424ee8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499539:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499545:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499551:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499557:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548738.499559:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499565:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499571:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548738.499573:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548738.499582:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499588:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424ee92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499639:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424ee84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a231d expref: 30 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499654:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ee99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a231d expref: 29 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548738.499663:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2cf6000) 00010000:00010000:0.0:1787548738.499665:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787548738.499668:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150c00, rc 0) 00000100:00100000:0.0:1787548738.500195:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+29:10488:x1874380416135936:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 2157us (2570us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787548738.500205:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 92 00000100:00100000:3.0:1787548738.504717:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548738.504791:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416136064 00000100:00100000:1.0:1787548738.504803:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416136064 00000100:00100000:1.0:1787548738.504883:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 93 00000100:00100000:1.0:1787548738.504894:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+29:10488:x1874380416136064:12345-192.168.206.13@tcp:54:lfs.0 00010000:00010000:1.0:1787548738.504979:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.504997:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2308 expref: 29 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.505007:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.505049:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2308 expref: 29 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.505064:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2308 expref: 29 pid: 5855 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548738.505081:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb42b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1874380431881984:192.168.206.13@tcp:104: 00000100:00100000:1.0:1787548738.505709:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca009dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787548738.509663:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548738.510443:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416136320 00000100:00100000:2.0:1787548738.510458:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416136320 00000100:00100000:2.0:1787548738.510534:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 22 00000100:00100000:2.0:1787548738.510547:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcefad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+30:5593:x1874380416136320:12345-192.168.206.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787548738.511486:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcefad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+31:5593:x1874380416136320:12345-192.168.206.13@tcp:35:ldlm_bl.0 Request processed in 936us (1832us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787548738.511498:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 22 00000100:00100000:1.0:1787548738.511779:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb42b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1874380431881984:192.168.206.13@tcp:104: 00010000:00010000:1.0:1787548738.511818:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548738.514517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548738.514685:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416136448 00000100:00100000:1.0:1787548738.514699:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416136448 00010000:00010000:1.0:1787548738.514983:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2308 expref: 31 pid: 5855 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548738.515073:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 48 00000100:00100000:1.0:1787548738.515086:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+31:2351:x1874380416136448:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548738.515106:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548738.515115:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2308 expref: 31 pid: 5855 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.515170:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2308 expref: 31 pid: 5855 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.515198:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ee4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2308 expref: 31 pid: 5855 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.515218:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2cf6000) 00010000:00010000:1.0:1787548738.515224:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.515235:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.515244:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.515303:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548738.515370:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+30:2351:x1874380416136448:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 286us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548738.515380:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 48 00010000:00010000:2.0:1787548738.515687:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.515699:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.515752:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.515760:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.515767:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.515774:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22ea00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548738.515779:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.515788:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.515812:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2cf6000) 00010000:00010000:2.0:1787548738.515815:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787548738.515820:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.515831:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424eea7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548738.516025:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+29:10488:x1874380416136064:12345-192.168.206.13@tcp:54:lfs.0 Request processed in 11131us (11320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548738.516036:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 93 00000100:00100000:2.0:1787548738.519485:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.519615:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416136704 00000100:00100000:3.0:1787548738.519629:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416136704 00000100:00100000:3.0:1787548738.519705:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 23 00000100:00100000:3.0:1787548738.519718:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+29:10488:x1874380416136704:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:2.0:1787548738.520513:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+30:10488:x1874380416136704:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 794us (1038us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787548738.520523:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 23 00000100:00100000:0.0:1787548738.601690:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.602169:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416136960 00000100:00100000:3.0:1787548738.602186:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416136960 00000100:00100000:3.0:1787548738.602268:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 94 00000100:00100000:3.0:1787548738.602280:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+30:10499:x1874380416136960:12345-192.168.206.13@tcp:101:cat.0 00010000:00010000:3.0:1787548738.602381:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548738.602411:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424eeae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2324 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.602504:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eeb5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.602521:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eeb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.602535:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eeb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.602553:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eebc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.602561:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.602567:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.603641:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424eec3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.603660:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424eec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.603692:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424eec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548738.603706:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787548738.603846:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eeb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.603854:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eeb5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.604285:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eeb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.604305:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548738.604310:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eeb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.604318:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eeb5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.604335:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:3.0:1787548738.604338:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548738.604344:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eeb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.604350:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eeb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.604366:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.604372:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eebc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.604389:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.604394:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548738.604397:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.604404:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eebc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.604413:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fec90d93400) 00010000:00010000:3.0:1787548738.604415:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548738.604418:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eebc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.604423:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eebc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.604966:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424eeae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2324 expref: 33 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.604990:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424eec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2324 expref: 32 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.604998:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2cf6000) 00010000:00010000:2.0:1787548738.605000:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548738.605003:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93200, rc 0) 00000100:00100000:2.0:1787548738.605105:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+32:10499:x1874380416136960:12345-192.168.206.13@tcp:101:cat.0 Request processed in 2826us (3440us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787548738.605115:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 94 00000100:00100000:0.0:1787548738.617488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548738.617672:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416137216 00000100:00100000:2.0:1787548738.617697:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416137216 00000100:00100000:2.0:1787548738.617783:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 24 00000100:00100000:2.0:1787548738.617796:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+32:10499:x1874380416137216:12345-192.168.206.13@tcp:35:cat.0 00000100:00100000:2.0:1787548738.618200:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+33:10499:x1874380416137216:12345-192.168.206.13@tcp:35:cat.0 Request processed in 406us (728us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787548738.618208:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 24 00000100:00100000:3.0:1787548738.621066:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.621122:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548738.621670:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416137344 00000100:00100000:0.0:1787548738.621693:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416137344 00000100:00100000:0.0:1787548738.621769:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 282 00000100:00100000:0.0:1787548738.621781:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2351:x1874380416137344:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548738.621889:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2351:x1874380416137344:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 109us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548738.621899:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 282 00000100:00100000:2.0:1787548738.622503:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416137472 00000100:00100000:2.0:1787548738.622510:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416137472 00000100:00080000:0.0:1787548738.622633:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787548738.622773:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 57 00000100:00100000:2.0:1787548738.622784:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416137472:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548738.622857:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416137472:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 75us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548738.622875:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 57 00000100:00100000:3.0:1787548738.626987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548738.630241:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416137600 00000100:00100000:0.0:1787548738.630265:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416137600 00000100:00100000:0.0:1787548738.630427:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 125 00000100:00100000:0.0:1787548738.630440:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92088e20-066b-499e-ac52-ab10992c506a+5:2351:x1874380416137600:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548738.630558:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92088e20-066b-499e-ac52-ab10992c506a+5:2351:x1874380416137600:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 119us (3584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548738.630578:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 125 00000100:00080000:3.0:1787548738.631637:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548738.656811:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.657305:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416137856 00000100:00100000:3.0:1787548738.657320:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416137856 00000100:00100000:3.0:1787548738.657409:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 95 00000100:00100000:3.0:1787548738.657422:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+33:10500:x1874380416137856:12345-192.168.206.13@tcp:36:rm.0 00010000:00010000:3.0:1787548738.657500:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787548738.657538:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424eec3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2324 expref: 33 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.657611:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ee99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a231d expref: 32 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.657628:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424ee61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a230f expref: 31 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.657639:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8feca2cf6000) 00010000:00010000:3.0:1787548738.657652:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787548738.657693:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eed1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.657721:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eed1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.657732:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eed1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.657761:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eed8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.657769:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eed8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.657776:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eed8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.658242:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eedf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.658253:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eedf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.658268:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eedf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787548738.658968:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1787548738.658982:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361535851319ns, next at 362535847635ns, rc = 0 00010000:00010000:3.0:1787548738.659056:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eee6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659068:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659080:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659088:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eee6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659094:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eee6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659101:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eee6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659164:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787548738.659190:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eedf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659197:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eedf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659203:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eedf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659216:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548738.659221:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eedf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659229:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eedf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659244:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec90d93800) 00010000:00010000:3.0:1787548738.659247:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787548738.659252:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eedf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659258:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eedf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659277:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eed1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659283:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eed1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659288:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eed1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659293:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548738.659296:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eed1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659302:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eed1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659320:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:3.0:1787548738.659322:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548738.659326:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eed1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.659332:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eed1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787548738.659342:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000740fff27 reply state 000000007ff3c002 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eed8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548738.659352:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787548738.659464:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+32:10500:x1874380416137856:12345-192.168.206.13@tcp:36:rm.0 Request processed in 2041us (2667us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787548738.659474:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 95 00010000:00010000:1.0:1787548738.661345:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548738.661360:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eee6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.661372:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93600 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548738.661377:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eee6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.661387:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eee6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.661408:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fec90d93800) 00010000:00010000:1.0:1787548738.661412:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787548738.661415:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eee6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.661422:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424eee6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.661449:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548738.661452:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548738.661454:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548738.679458:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eed8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.679480:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eed8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.679489:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eed8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.679495:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548738.679501:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eed8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.679509:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eed8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.679555:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fec90d93400) 00010000:00010000:3.0:1787548738.679559:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548738.679564:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eed8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.679580:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eed8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548738.763335:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.763480:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416138112 00000100:00100000:3.0:1787548738.763495:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416138112 00000100:00100000:3.0:1787548738.763579:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 96 00000100:00100000:3.0:1787548738.763592:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+31:10506:x1874380416138112:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:3.0:1787548738.763623:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548738.763650:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eeed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a232b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.763842:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eef4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.763860:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eef4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.763875:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eef4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.763892:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eefb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.763899:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eefb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.763924:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eefb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787548738.764657:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787548738.764883:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ef02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.764897:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ef02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.764907:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ef02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.764948:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eef4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.764956:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eef4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.764964:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eef4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.764970:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548738.764975:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eef4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.764984:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eef4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.764999:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:3.0:1787548738.765002:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548738.765016:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eef4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.765022:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424eef4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787548738.765039:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b72ea9b4 reply state 00000000e9bd4cf6 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eefb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548738.765049:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787548738.765087:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424eeed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a232b expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.765103:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ef02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a232b expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.765110:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec90d93300) 00010000:00010000:3.0:1787548738.765112:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787548738.765115:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93400, rc 0) 00000100:00100000:3.0:1787548738.765263:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+34:10506:x1874380416138112:12345-192.168.206.13@tcp:101:bash.0 Request processed in 1673us (1943us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787548738.765273:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 96 00010000:00010000:2.0:1787548738.772904:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eefb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.772928:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eefb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.772939:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eefb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.772946:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548738.772953:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eefb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.772962:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eefb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.773007:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fec90d93400) 00010000:00010000:2.0:1787548738.773011:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548738.773017:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eefb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.773025:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eefb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548738.783107:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.783591:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416138240 00000100:00100000:3.0:1787548738.783607:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416138240 00000100:00100000:3.0:1787548738.783696:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 34 00000100:00100000:3.0:1787548738.783708:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416138240:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:3.0:1787548738.783732:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548738.783761:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424ef10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2332 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787548738.783816:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787548738.783851:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1787548738.783856:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548738.783869:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424ef10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2332 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.783892:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424ef10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2332 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.783909:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93e00, rc 0) 00000100:00100000:3.0:1787548738.783989:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416138240:12345-192.168.206.13@tcp:101:bash.0 Request processed in 283us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548738.783997:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 34 00000100:00100000:0.0:1787548738.805698:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548738.805816:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416138368 00000100:00100000:1.0:1787548738.805838:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416138368 00000100:00100000:1.0:1787548738.805911:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 35 00000100:00100000:1.0:1787548738.805923:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:10506:x1874380416138368:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:1.0:1787548738.805969:0:10297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548738.805995:0:10297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2339 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.806037:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424ef10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2332 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.806047:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548738.806052:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548738.806058:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 7 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.806104:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424ef10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2332 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.806121:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424ef10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2332 expref: 7 pid: 6691 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548738.806185:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb42b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10297:1874380431882112:192.168.206.13@tcp:104: 00000100:00100000:1.0:1787548738.806298:0:10297:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca009dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787548738.819930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548738.820035:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416138496 00000100:00100000:2.0:1787548738.820047:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416138496 00010000:00010000:2.0:1787548738.820099:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424ef10 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2332 expref: 8 pid: 6691 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548738.820187:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 49 00000100:00100000:2.0:1787548738.820199:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2352:x1874380416138496:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548738.820220:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548738.820252:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424ef10 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2332 expref: 8 pid: 6691 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.820269:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424ef10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2332 expref: 8 pid: 6691 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.820300:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548738.820306:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548738.820316:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 8 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.820350:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 8 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548738.820400:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 8 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548738.820416:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5839:1874380431882240:192.168.206.13@tcp:105: 00000100:00100000:2.0:1787548738.820506:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1b40 going to sleep for 11 seconds 00010000:00010000:1.0:1787548738.821048:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424ef10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2332 expref: 8 pid: 6691 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548738.821071:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb42b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10297:1874380431882112:192.168.206.13@tcp:104: 00010000:00010000:1.0:1787548738.821105:0:10297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 7 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548738.821184:0:10297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22f600, rc 0) 00000100:00100000:1.0:1787548738.821238:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:10506:x1874380416138368:12345-192.168.206.13@tcp:101:bash.0 Request processed in 15316us (15565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548738.821247:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 35 00000100:00100000:2.0:1787548738.828749:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5839:1874380431882240:192.168.206.13@tcp:105: 00010000:00010000:2.0:1787548738.828784:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548738.828868:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416138496:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 8669us (8952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548738.828882:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 49 00000100:00100000:2.0:1787548738.831432:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.835560:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416138752 00000100:00100000:3.0:1787548738.835581:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416138752 00000100:00100000:3.0:1787548738.835737:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 25 00000100:00100000:3.0:1787548738.835750:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+33:10506:x1874380416138752:12345-192.168.206.13@tcp:35:bash.0 00000100:00100000:3.0:1787548738.839791:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+34:10506:x1874380416138752:12345-192.168.206.13@tcp:35:bash.0 Request processed in 2194us (6527us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787548738.839821:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 25 00000100:00100000:0.0:1787548738.991171:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.991368:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416138880 00000100:00100000:3.0:1787548738.991382:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416138880 00000100:00100000:3.0:1787548738.991460:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 97 00000100:00100000:3.0:1787548738.991472:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+34:10522:x1874380416138880:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548738.991533:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548738.991560:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ef1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2340 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.991656:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ef25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.991683:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ef25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.991697:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ef25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548738.992096:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787548738.992101:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548738.992160:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ef25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.992194:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424ef1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2340 expref: 36 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.992218:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ef25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2340 expref: 35 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.992228:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:3.0:1787548738.992231:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787548738.992235:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93200, rc 0) 00000100:00100000:3.0:1787548738.992320:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+35:10522:x1874380416138880:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 850us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548738.992328:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 97 00000100:00100000:0.0:1787548738.996854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548738.997113:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416139136 00000100:00100000:3.0:1787548738.997127:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416139136 00000100:00100000:3.0:1787548738.997237:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 98 00000100:00100000:3.0:1787548738.997250:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+35:10522:x1874380416139136:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548738.997277:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548738.997303:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424ef2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2347 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.997441:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ef33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.997457:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ef33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.997470:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ef33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548738.997482:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787548738.997641:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424ef2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2347 expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.997664:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ef33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2347 expref: 37 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548738.997682:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec90d93300) 00010000:00010000:3.0:1787548738.997685:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787548738.997690:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93e00, rc 0) 00000100:00100000:3.0:1787548738.998008:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+37:10522:x1874380416139136:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 759us (1169us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787548738.998038:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 98 00000100:00100000:2.0:1787548739.003799:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548739.004027:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416139392 00000100:00100000:0.0:1787548739.004041:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416139392 00000100:00100000:0.0:1787548739.004111:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 99 00000100:00100000:0.0:1787548739.004122:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+37:10522:x1874380416139392:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548739.004188:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548739.004213:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ef41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a234e expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.004366:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ef48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.004385:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ef48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.004399:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ef48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548739.004423:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787548739.004585:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ef41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a234e expref: 40 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.004606:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ef48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a234e expref: 39 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.004615:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec90d93300) 00010000:00010000:0.0:1787548739.004618:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787548739.004622:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150600, rc 0) 00000100:00100000:0.0:1787548739.004704:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:10522:x1874380416139392:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 583us (922us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787548739.004712:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 99 00000100:00100000:2.0:1787548739.005146:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548739.005226:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416139520 00000100:00100000:1.0:1787548739.005233:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416139520 00000100:00100000:1.0:1787548739.005287:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 6 00000100:00100000:1.0:1787548739.005297:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:2351:x1874380416139520:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548739.005311:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548739.005332:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424ef33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2347 expref: 39 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.005348:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec90d93300) 00010000:00010000:1.0:1787548739.005352:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548739.005398:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+38:2351:x1874380416139520:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 103us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548739.005405:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 6 00010000:00010000:2.0:1787548739.011435:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548739.014091:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548739.014285:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416139648 00000100:00100000:3.0:1787548739.014299:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416139648 00000100:00100000:3.0:1787548739.014371:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 36 00000100:00100000:3.0:1787548739.014383:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416139648:12345-192.168.206.13@tcp:1:lfs.0 00010000:00010000:3.0:1787548739.014442:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424ef56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.014465:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 6 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.014473:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548739.014479:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787548739.014484:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424ef56 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.014530:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 6 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.014545:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 6 pid: 10297 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548739.014562:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcef8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1874380431882368:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548739.014771:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec988b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1787548739.023022:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548739.023143:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416139776 00000100:00100000:1.0:1787548739.023156:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416139776 00002000:00100000:1.0:1787548739.023222:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8fec8833f100 x1874380416139776/t0(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:180/0 lens 504/0 e 0 to 0 dl 1787548750 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787548739.023236:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fec8833f100 with x1874380416139776 ext(0->8) 00010000:00010000:1.0:1787548739.023247:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 7 pid: 10297 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.023280:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 7 pid: 10297 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787548739.023290:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fec8833f100 00000100:00100000:1.0:1787548739.023333:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 1 00000100:00100000:1.0:1787548739.023344:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2352:x1874380416139776:12345-192.168.206.13@tcp:4:lfs.0 00000100:00100000:1.0:1787548739.024225:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2352:x1874380416139776:12345-192.168.206.13@tcp:4:lfs.0 Request processed in 875us (1209us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787548739.024236:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 1 00002000:00100000:1.0:1787548739.024246:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8fec8833f100 x1874380416139776/t4294967302(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:180/0 lens 504/448 e 0 to 0 dl 1787548750 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787548739.024255:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fec8833f100 with x1874380416139776 ext(0->8) 00010000:00010000:1.0:1787548739.024262:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 9 pid: 10297 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.024280:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 9 pid: 10297 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787548739.024288:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fec8833f100 00000100:00100000:0.0:1787548739.028087:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcef8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1874380431882368:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548739.028149:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424ef56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548739.028310:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548739.028494:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416139904 00000100:00100000:3.0:1787548739.028516:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416139904 00010000:00010000:3.0:1787548739.028559:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 9 pid: 10297 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548739.028611:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 50 00000100:00100000:3.0:1787548739.028622:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2352:x1874380416139904:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548739.028640:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787548739.028665:0:5841:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787548739.028668:0:5841:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787548739 00002000:00010000:3.0:1787548739.028680:0:5841:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787548739 00002000:00010000:3.0:1787548739.028683:0:5841:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787548739 00010000:00010000:3.0:1787548739.028690:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 9 pid: 10297 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.028705:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 9 pid: 10297 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.029069:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1fbec62/0xcb7c48919424ef17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2339 expref: 9 pid: 10297 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.029091:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787548739.029097:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787548739.029104:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424ef56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.029115:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424ef56 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.029258:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548739.029330:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2352:x1874380416139904:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 709us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548739.029339:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 50 00010000:00010000:0.0:1787548739.031011:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424ef56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.031036:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424ef56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.031083:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424ef56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.031118:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424ef56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.031127:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424ef56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.031205:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92600 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548739.031210:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424ef56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.031221:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424ef56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.031247:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424ef56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.031255:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424ef56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548739.031444:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2351:x1874380416139648:12345-192.168.206.13@tcp:1:lfs.0 Request processed in 17057us (17362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548739.031455:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 36 00000100:00100000:2.0:1787548739.034931:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548739.035111:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416140160 00000100:00100000:1.0:1787548739.035126:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416140160 00000100:00100000:1.0:1787548739.035347:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 26 00000100:00100000:1.0:1787548739.035360:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca6f14850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+38:10522:x1874380416140160:12345-192.168.206.13@tcp:35:lfs.0 00000004:00010000:1.0:1787548739.035461:0:5858:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ef48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a234e expref: 38 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787548739.035809:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1787548739.036032:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1787548739.036551:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1787548739.037074:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.037098:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ef02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a232b expref: 42 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.037108:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.038412:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ef02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a232b expref: 42 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.038442:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ef02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a232b expref: 42 pid: 5854 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548739.038462:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb42b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5858:1874380431882496:192.168.206.13@tcp:104: 00000100:00100000:1.0:1787548739.038587:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca009dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787548739.042380:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548739.042614:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb42b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5858:1874380431882496:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548739.042653:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548739.042981:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416140288 00000100:00100000:3.0:1787548739.042992:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416140288 00010000:00010000:3.0:1787548739.043043:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ef02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a232b expref: 43 pid: 5854 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548739.043089:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 51 00000100:00100000:3.0:1787548739.043100:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+43:2351:x1874380416140288:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548739.043121:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548739.043175:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ef02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a232b expref: 43 pid: 5854 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.043190:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ef02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a232b expref: 43 pid: 5854 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.043215:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424ef02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a232b expref: 43 pid: 5854 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.043235:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec90d93300) 00010000:00010000:3.0:1787548739.043241:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.043252:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.043276:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.043307:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548739.043372:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+42:2351:x1874380416140288:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 273us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548739.043380:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 51 00010000:00010000:2.0:1787548739.043450:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.043466:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787548739.043632:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787548739.044092:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1787548739.044283:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431882624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787548739.044358:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548739.044397:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787548739.044433:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431882624 00000100:00100000:2.0:1787548739.044439:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431882624 00000100:00100000:2.0:1787548739.044496:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787548739.044505:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1874380431882624:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787548739.044586:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1874380431882624:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548739.044592:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787548739.044614:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787548739.044641:0:5858:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1787548739.044648:0:5858:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1787548739.044668:0:5858:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fecbd061c00, transno 4294967301 00000100:00100000:2.0:1787548739.044695:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431882624:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787548739.047543:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1787548739.048122:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431882752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787548739.048343:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548739.048574:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1000 going to sleep for 11 seconds 00000100:00100000:0.0:1787548739.048662:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431882752 00000100:00100000:0.0:1787548739.048681:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431882752 00000100:00100000:0.0:1787548739.048978:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787548739.049005:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1874380431882752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787548739.049500:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5858:x1874380431882752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 497us (1155us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787548739.049509:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787548739.049713:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431882752:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787548739.050240:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787548739.050300:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.050313:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.050321:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.050328:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548739.050333:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.050341:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.050361:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec90d93300) 00010000:00010000:3.0:1787548739.050364:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787548739.050369:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.050392:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424ef5d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787548739.050781:0:5858:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787548739.051045:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787548739.051060:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361927929013ns, next at 362927926396ns, rc = 0 00000001:00080000:3.0:1787548739.051069:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787548739.051116:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec90d93300) 00010000:00010000:3.0:1787548739.051120:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787548739.051172:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424ef48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a234e expref: 46 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548739.051312:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca6f14850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+45:10522:x1874380416140160:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 15953us (16620us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787548739.051325:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 26 00000020:00080000:3.0:1787548739.051331:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787548739.054298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548739.054413:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416140416 00000100:00100000:2.0:1787548739.054426:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416140416 00000100:00100000:2.0:1787548739.054507:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 100 00000100:00100000:2.0:1787548739.054518:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+45:10522:x1874380416140416:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548739.054548:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548739.054586:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ef64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2355 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.054662:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ef64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2355 expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.054690:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ef64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2355 expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.054714:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:2.0:1787548739.054718:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787548739.054722:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7e00, rc 0) 00000100:00100000:2.0:1787548739.054966:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+46:10522:x1874380416140416:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 450us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548739.054974:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 100 00000100:00100000:1.0:1787548739.058197:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548739.058375:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416140672 00000100:00100000:3.0:1787548739.058388:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416140672 00000100:00100000:3.0:1787548739.058462:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 27 00000100:00100000:3.0:1787548739.058474:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+46:10522:x1874380416140672:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:3.0:1787548739.059183:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+47:10522:x1874380416140672:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 709us (1000us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787548739.059192:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 27 00000100:00100000:1.0:1787548739.139054:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548739.139186:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416140800 00000100:00100000:0.0:1787548739.139198:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416140800 00000100:00100000:0.0:1787548739.139260:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 101 00000100:00100000:0.0:1787548739.139270:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+47:10532:x1874380416140800:12345-192.168.206.13@tcp:34:lfs.0 00010000:00010000:0.0:1787548739.139365:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ef6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139386:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ef6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139404:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ef6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139425:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ef72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139431:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ef72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139438:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ef72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139563:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ef79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139572:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ef79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139600:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ef79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787548739.139650:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ef79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139664:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ef6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139680:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ef6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139688:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ef6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139694:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548739.139700:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ef6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139708:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ef6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139723:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:0.0:1787548739.139727:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548739.139938:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ef6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139946:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424ef6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139962:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ef72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139975:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ef72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139981:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ef72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139986:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548739.139989:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ef72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.139994:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ef72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.140002:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548739.140005:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548739.140007:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ef72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.140014:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424ef72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.140030:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ef79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.140036:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ef79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.140042:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ef79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.140047:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548739.140056:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ef79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.140062:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ef79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.140070:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:0.0:1787548739.140072:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548739.140074:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ef79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.140080:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424ef79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548739.140238:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+47:10532:x1874380416140800:12345-192.168.206.13@tcp:34:lfs.0 Request processed in 966us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548739.140248:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 101 00000100:00100000:1.0:1787548739.176266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548739.176432:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416141056 00000100:00100000:2.0:1787548739.176446:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416141056 00000100:00100000:2.0:1787548739.176523:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 102 00000100:00100000:2.0:1787548739.176534:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+47:10535:x1874380416141056:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548739.176562:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548739.176600:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ef80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a235c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.176707:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424ef87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.176998:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424ef87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177014:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424ef87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177036:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ef8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177044:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ef8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177052:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ef8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177253:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ef95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177261:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ef95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177269:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ef95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548739.177281:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787548739.177409:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424ef87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177417:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424ef87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177424:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424ef87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177438:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548739.177443:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424ef87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177450:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424ef87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177464:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:2.0:1787548739.177467:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548739.177471:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424ef87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177478:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424ef87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177491:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ef8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177496:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ef8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177502:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ef8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177506:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548739.177509:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ef8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177515:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ef8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177531:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fec87ceb400) 00010000:00010000:2.0:1787548739.177534:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548739.177536:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ef8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177542:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424ef8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177592:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424ef80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a235c expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177608:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ef95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a235c expref: 49 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.177615:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:2.0:1787548739.177617:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548739.177620:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7200, rc 0) 00000100:00100000:2.0:1787548739.177711:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+49:10535:x1874380416141056:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 1178us (1460us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787548739.177720:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 102 00000100:00100000:2.0:1787548739.182360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548739.182465:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416141184 00000100:00100000:0.0:1787548739.182480:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416141184 00000100:00100000:0.0:1787548739.182554:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 103 00000100:00100000:0.0:1787548739.182567:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+49:10535:x1874380416141184:12345-192.168.206.13@tcp:54:lfs.0 00010000:00010000:0.0:1787548739.182667:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424efa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.182699:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424efa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.182714:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424efa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.182750:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424efa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.182775:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424efa3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.182782:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424efa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.182789:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548739.182795:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424efa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.182803:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424efa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.182818:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:0.0:1787548739.182834:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787548739.182840:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424efa3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.182846:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424efa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548739.183107:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+49:10535:x1874380416141184:12345-192.168.206.13@tcp:54:lfs.0 Request processed in 541us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548739.183116:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 103 00000100:00100000:1.0:1787548739.188219:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548739.188479:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416141440 00000100:00100000:2.0:1787548739.188493:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416141440 00000100:00100000:2.0:1787548739.188565:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 28 00000100:00100000:2.0:1787548739.188694:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+49:10535:x1874380416141440:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:2.0:1787548739.189431:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+50:10535:x1874380416141440:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 733us (1220us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787548739.189461:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 28 00000100:00100000:1.0:1787548739.261755:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548739.262006:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416141696 00000100:00100000:3.0:1787548739.262019:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416141696 00000100:00100000:3.0:1787548739.262103:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 104 00000100:00100000:3.0:1787548739.262116:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+50:10545:x1874380416141696:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:3.0:1787548739.262206:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548739.262211:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787548739.262249:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424ef25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2340 expref: 50 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.262274:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:3.0:1787548739.262280:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787548739.262295:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424efaa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2363 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.262437:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.262453:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ef95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a235c expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.262463:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.262504:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ef95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a235c expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.262519:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ef95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a235c expref: 50 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548739.262534:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcefad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431882880:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548739.262647:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865e53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548739.266645:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548739.266778:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416141824 00000100:00100000:0.0:1787548739.266791:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416141824 00010000:00010000:0.0:1787548739.266854:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ef95 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a235c expref: 51 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548739.267625:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 52 00000100:00100000:0.0:1787548739.267657:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:2352:x1874380416141824:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548739.267690:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548739.267701:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ef95 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a235c expref: 51 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.267718:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ef95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a235c expref: 51 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.267795:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:0.0:1787548739.267802:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.267814:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.267984:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548739.268013:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548739.268093:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:2352:x1874380416141824:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 438us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548739.268102:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 52 00010000:00010000:3.0:1787548739.268528:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424ef95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a235c expref: 50 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548739.268573:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcefad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431882880:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548739.268599:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.268609:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.268616:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548739.268640:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787548739.269043:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424efaa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2363 expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.269062:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2363 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.269071:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:3.0:1787548739.269075:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787548739.269077:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92800, rc 0) 00000100:00100000:3.0:1787548739.269171:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+50:10545:x1874380416141696:12345-192.168.206.13@tcp:101:bash.0 Request processed in 7058us (7446us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787548739.269181:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 104 00000100:00100000:1.0:1787548739.274096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548739.274230:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416142080 00000100:00100000:2.0:1787548739.274244:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416142080 00000100:00100000:2.0:1787548739.274324:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 105 00000100:00100000:2.0:1787548739.274337:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+50:10545:x1874380416142080:12345-192.168.206.13@tcp:36:bash.0 00010000:00010000:2.0:1787548739.274721:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424efbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.274756:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424efbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.274771:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424efbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787548739.274847:0:8467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787548739.275356:0:8467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fe80b0b reply state 00000000987a98d3 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424efbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548739.275368:0:8467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787548739.275507:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+53:10545:x1874380416142080:12345-192.168.206.13@tcp:36:bash.0 Request processed in 1171us (1425us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787548739.275517:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 105 00000020:00080000:2.0:1787548739.275523:0:8467:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787548739.278776:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424efbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.278798:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424efbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.278807:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424efbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.278844:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548739.278851:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424efbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.279496:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424efbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.279527:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:2.0:1787548739.279530:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548739.279536:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424efbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.279543:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424efbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548739.281311:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548739.281540:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416142208 00000100:00100000:3.0:1787548739.281553:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416142208 00000100:00100000:3.0:1787548739.281632:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 106 00000100:00100000:3.0:1787548739.281643:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+52:10545:x1874380416142208:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:3.0:1787548739.281697:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548739.281721:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424efc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a236a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.281839:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.281858:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2363 expref: 53 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.282694:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.282815:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2363 expref: 53 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.282964:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2363 expref: 53 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548739.282985:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcefad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1874380431883008:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548739.283103:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865e5300 going to sleep for 11 seconds 00000100:00100000:3.0:1787548739.286598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548739.286688:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416142336 00000100:00100000:1.0:1787548739.286701:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416142336 00010000:00010000:1.0:1787548739.286765:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2363 expref: 54 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548739.286812:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 53 00000100:00100000:1.0:1787548739.286829:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:2352:x1874380416142336:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548739.286847:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548739.286856:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2363 expref: 54 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.286881:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2363 expref: 54 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.286909:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:1.0:1787548739.286915:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.286926:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.286935:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.286980:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548739.287054:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:2352:x1874380416142336:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 232us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548739.287061:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 53 00010000:00010000:2.0:1787548739.287419:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424efb1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2363 expref: 53 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548739.287438:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcefad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1874380431883008:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548739.287464:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.287475:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.287481:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548739.287538:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787548739.287549:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548739.287588:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.287626:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424efc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a236a expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.287640:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a236a expref: 52 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.287649:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:2.0:1787548739.287652:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548739.287654:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93600, rc 0) 00000100:00100000:2.0:1787548739.287700:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+52:10545:x1874380416142208:12345-192.168.206.13@tcp:101:bash.0 Request processed in 6059us (6404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548739.287707:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 106 00000100:00100000:0.0:1787548739.291989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548739.292168:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416142592 00000100:00100000:3.0:1787548739.292182:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416142592 00000100:00100000:3.0:1787548739.292250:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 29 00000100:00100000:3.0:1787548739.292262:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+52:10545:x1874380416142592:12345-192.168.206.13@tcp:35:bash.0 00000100:00100000:3.0:1787548739.292579:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+53:10545:x1874380416142592:12345-192.168.206.13@tcp:35:bash.0 Request processed in 318us (603us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787548739.292601:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 29 00000100:00100000:3.0:1787548739.354466:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548739.354643:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416142720 00000100:00100000:2.0:1787548739.354656:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416142720 00000100:00100000:2.0:1787548739.354749:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 107 00000100:00100000:2.0:1787548739.354761:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+53:10551:x1874380416142720:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548739.354795:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548739.354821:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424efd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2371 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.354906:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424efdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.354922:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424efdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.354957:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424efdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548739.355038:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787548739.355043:0:8467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548739.355067:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424efdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.355097:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424efd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2371 expref: 55 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.355119:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424efdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2371 expref: 54 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.355201:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:2.0:1787548739.355204:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787548739.355209:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7600, rc 0) 00000100:00100000:2.0:1787548739.355274:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:10551:x1874380416142720:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 516us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548739.355282:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 107 00000100:00100000:1.0:1787548739.368886:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548739.368995:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416142848 00000100:00100000:3.0:1787548739.369007:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416142848 00000100:00100000:3.0:1787548739.369077:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 108 00000100:00100000:3.0:1787548739.369088:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:10551:x1874380416142848:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548739.369117:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548739.369234:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424efe2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2378 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.369312:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424efe9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.369636:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424efe9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.369653:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424efe9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.369684:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424eff0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.369692:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424eff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.369698:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424eff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.370954:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eff7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.370994:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371007:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548739.371062:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787548739.371067:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548739.371089:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371103:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371113:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424efe9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371161:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424efe9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371170:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424efe9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371175:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548739.371180:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424efe9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371188:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424efe9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371203:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:3.0:1787548739.371207:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548739.371220:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424efe9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371227:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424efe9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371245:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424eff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371251:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424eff0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371257:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424eff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371262:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548739.371265:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424eff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371271:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424eff0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371280:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fec90d93300) 00010000:00010000:3.0:1787548739.371282:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548739.371285:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424eff0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.371291:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424eff0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.373009:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424efe2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2378 expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.373074:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2378 expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.373085:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:3.0:1787548739.373088:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787548739.373092:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92a00, rc 0) 00000100:00100000:3.0:1787548739.374538:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:10551:x1874380416142848:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 5436us (5710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548739.374554:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 108 00000100:00100000:0.0:1787548739.379216:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548739.379319:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416142976 00000100:00100000:2.0:1787548739.379346:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416142976 00000100:00100000:2.0:1787548739.379417:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:2.0:1787548739.379430:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:2351:x1874380416142976:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548739.379451:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548739.379482:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424eff7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2378 expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.379526:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:2.0:1787548739.379532:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548739.379609:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:2351:x1874380416142976:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 181us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548739.379617:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:1.0:1787548739.381777:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548739.382039:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416143232 00000100:00100000:2.0:1787548739.382051:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416143232 00000100:00100000:2.0:1787548739.382120:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 109 00000100:00100000:2.0:1787548739.382157:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:10551:x1874380416143232:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548739.382187:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548739.382212:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424effe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a237f expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.382361:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.382380:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a236a expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.382390:0:8467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.382431:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a236a expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.382448:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a236a expref: 55 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548739.382488:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec87e90000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431883136:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548739.382604:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787548739.386172:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548739.386292:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec87e90000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431883136:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548739.386342:0:8467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548739.387608:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416143360 00000100:00100000:3.0:1787548739.387623:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416143360 00010000:00010000:3.0:1787548739.387690:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a236a expref: 56 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548739.387737:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 54 00000100:00100000:3.0:1787548739.387750:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:2352:x1874380416143360:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548739.387768:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548739.387775:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a236a expref: 56 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.387790:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a236a expref: 56 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.387816:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424efcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a236a expref: 56 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.387863:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:3.0:1787548739.387869:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.387879:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.387887:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548739.387927:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548739.387993:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:2352:x1874380416143360:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 245us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548739.388002:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 54 00010000:00010000:1.0:1787548739.388428:0:8467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.388437:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548739.388462:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787548739.388662:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424effe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a237f expref: 56 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.388702:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a237f expref: 55 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.388711:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:1.0:1787548739.388714:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787548739.388717:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6200, rc 0) 00000100:00100000:1.0:1787548739.388771:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:10551:x1874380416143232:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 6641us (7010us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787548739.388779:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 109 00000100:00100000:1.0:1787548739.391199:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548739.391304:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416143616 00000100:00100000:2.0:1787548739.391316:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416143616 00000100:00100000:2.0:1787548739.391410:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 8 00000100:00100000:2.0:1787548739.391421:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:10551:x1874380416143616:12345-192.168.206.13@tcp:103:lfs.0 00010000:00010000:2.0:1787548739.391440:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548739.391469:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424ef64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2355 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.391492:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:2.0:1787548739.391497:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548739.391560:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:10551:x1874380416143616:12345-192.168.206.13@tcp:103:lfs.0 Request processed in 141us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548739.391567:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 8 00000100:00100000:0.0:1787548739.394404:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548739.394944:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416143744 00000100:00100000:2.0:1787548739.394958:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416143744 00000100:00100000:2.0:1787548739.395029:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 110 00000100:00100000:2.0:1787548739.395041:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:10551:x1874380416143744:12345-192.168.206.13@tcp:58:lfs.0 00010000:00010000:2.0:1787548739.395198:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f013 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.395237:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f013 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548739.395252:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f013 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787548739.395639:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787548739.396059:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:10551:x1874380416143744:12345-192.168.206.13@tcp:58:lfs.0 Request processed in 1014us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548739.396070:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 110 00000100:00100000:3.0:1787548739.405446:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548739.405722:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416143872 00000100:00100000:1.0:1787548739.405745:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416143872 00000100:00100000:1.0:1787548739.405834:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 111 00000100:00100000:1.0:1787548739.405846:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:10551:x1874380416143872:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:1.0:1787548739.405874:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548739.405899:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e000/0xcb7c48919424f01a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2386 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.405977:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f013 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.405988:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e000/0xcb7c48919424f01a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2386 expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.406012:0:5855:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f013 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.406027:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e000/0xcb7c48919424f01a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2386 expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.406044:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:1.0:1787548739.406047:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787548739.406051:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e000/0xcb7c48919424f01a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2386 expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548739.406060:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22e000, rc 0) 00000100:00100000:1.0:1787548739.406185:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:10551:x1874380416143872:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 341us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548739.406193:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 111 00010000:00010000:2.0:1787548740.035602:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548740.099784:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787548740.099812:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb515e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431883264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548740.099922:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787548740.100298:0:8095:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362977166623ns, next at 363977163795ns, rc = 0 00000100:00100000:2.0:1787548740.100498:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431883264 00000100:00100000:2.0:1787548740.100509:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431883264 00000100:00100000:2.0:1787548740.100596:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787548740.100609:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874380431883264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787548740.100683:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548740.100762:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874380431883264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548740.100769:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787548740.100834:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb515e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431883264:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787548740.101346:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787548740.101758:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb515c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431883648:0@lo:400:kworker.0 00000100:00100000:1.0:1787548740.101814:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548740.102491:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787548740.102504:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb515c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431883776:0@lo:400:kworker.0 00000100:00100000:1.0:1787548740.102547:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548740.103090:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb515d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431883392:0@lo:400:kworker.0 00000100:00100000:3.0:1787548740.103170:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548740.103199:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb515df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431883904:0@lo:400:kworker.0 00000100:00100000:3.0:1787548740.103227:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548740.103249:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787548740.103268:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb515ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431883520:0@lo:400:kworker.0 00000100:00100000:3.0:1787548740.103293:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548740.103349:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431883648 00000100:00100000:3.0:1787548740.103357:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431883648 00000100:00080000:3.0:1787548740.103398:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548740.103449:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431883904 00000100:00100000:3.0:1787548740.103453:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431883904 00000100:00080000:3.0:1787548740.103486:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548740.103500:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431883520 00000100:00100000:3.0:1787548740.103504:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431883520 00000100:00100000:3.0:1787548740.103517:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787548740.103526:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431883648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548740.104216:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431883648:12345-0@lo:400:kworker.0 Request processed in 687us (2399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548740.104228:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787548740.104288:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb515c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431883648:0@lo:400:kworker.0 00000100:00100000:3.0:1787548740.104336:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787548740.104347:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431883904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548740.104586:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787548740.104598:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431883520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548740.104653:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431883520:12345-0@lo:400:kworker.0 Request processed in 58us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548740.104659:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787548740.104702:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb515ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431883520:0@lo:400:kworker.0 00000004:00080000:2.0:1787548740.105236:0:6723:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362982104113ns, next at 363982101355ns, rc = 0 00000100:00100000:2.0:1787548740.105259:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787548740.105272:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec87e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431884032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787548740.105343:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548740.105421:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431883776 00000100:00100000:2.0:1787548740.105427:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431883776 00000100:00100000:2.0:1787548740.105471:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787548740.105488:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874380431883776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548740.105537:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874380431883776:12345-0@lo:400:kworker.0 Request processed in 52us (2989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548740.105543:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787548740.105646:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb515c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431883776:0@lo:400:kworker.0 00000100:00100000:3.0:1787548740.106113:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431883904:12345-0@lo:400:kworker.0 Request processed in 1768us (2882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548740.106123:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787548740.106998:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431883392 00000100:00100000:1.0:1787548740.107011:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431883392 00000100:00100000:1.0:1787548740.107075:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787548740.107087:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431883392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548740.107180:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431883392:12345-0@lo:400:kworker.0 Request processed in 96us (4009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548740.107187:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787548740.107228:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431884032 00000100:00100000:1.0:1787548740.107232:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431884032 00000100:00100000:1.0:1787548740.107264:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787548740.107271:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874380431884032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787548740.107291:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548740.107347:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874380431884032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548740.107354:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787548740.108754:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec87e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431884032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787548740.108776:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb515d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431883392:0@lo:400:kworker.0 00000100:00100000:2.0:1787548740.108792:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb515df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431883904:0@lo:400:kworker.0 00000040:00080000:2.0:1787548740.357840:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787548740.357853:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787548740.357945:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787548740.357960:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787548740.358696:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5124e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874380431884160:192.168.206.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787548740.358916:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2df1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787548740.365978:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5124e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874380431884160:192.168.206.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787548740.369786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548740.370213:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416144000 00000100:00100000:3.0:1787548740.370228:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416144000 00000100:00100000:3.0:1787548740.370331:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 112 00000100:00100000:3.0:1787548740.370343:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:10552:x1874380416144000:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787548740.370395:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787548740.370707:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:10552:x1874380416144000:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 Request processed in 365us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548740.370716:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 112 00000100:00080000:0.0:1787548740.371034:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548740.382842:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548740.383025:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416144128 00000100:00100000:2.0:1787548740.383039:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416144128 00000100:00100000:2.0:1787548740.383113:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 113 00000100:00100000:2.0:1787548740.383126:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:10552:x1874380416144128:12345-192.168.206.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787548740.383271:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f021 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.383293:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f021 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.383329:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f021 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.386113:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f028 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.386161:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f028 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.386174:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f028 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.386206:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f02f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.386216:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f02f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.386223:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f02f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548740.386955:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787548740.386961:0:8467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548740.386977:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f02f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387087:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f021 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387095:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f021 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387118:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f021 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387124:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548740.387153:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f021 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387160:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f021 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387173:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8feca2d51a00) 00010000:00010000:2.0:1787548740.387176:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548740.387180:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f021 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387187:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f021 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387202:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f028 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387210:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f028 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387214:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f028 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387220:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548740.387222:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f028 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387627:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f028 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387640:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8fec87ceb400) 00010000:00010000:2.0:1787548740.387643:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548740.387646:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f028 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387653:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f028 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387680:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f02f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387686:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f02f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387692:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f02f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387697:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548740.387700:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f02f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387706:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f02f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387712:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:2.0:1787548740.387714:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548740.387717:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f02f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.387733:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f02f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548740.387827:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:10552:x1874380416144128:12345-192.168.206.13@tcp:34:lhsmtool_posix.0 Request processed in 4701us (4995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548740.387836:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 113 00000100:00100000:1.0:1787548740.396751:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548740.398608:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416144384 00000100:00100000:2.0:1787548740.398622:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416144384 00000100:00100000:2.0:1787548740.398701:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 114 00000100:00100000:2.0:1787548740.398712:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:10552:x1874380416144384:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787548740.398731:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548740.398751:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f036 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a238d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.398843:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f03d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.398857:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f03d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.398868:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f03d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548740.398879:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787548740.398975:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f03d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.398983:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f03d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.399234:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f03d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.399252:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548740.399256:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f03d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.399264:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f03d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.399277:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:2.0:1787548740.399280:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787548740.399284:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f03d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.399291:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f03d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.399331:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f036 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a238d expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.399341:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8feca2d51a00) 00010000:00010000:2.0:1787548740.399344:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787548740.399347:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f036 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a238d expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.399357:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7200, rc 0) 00000100:00100000:2.0:1787548740.399758:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:10552:x1874380416144384:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 1046us (3013us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787548740.399778:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 114 00000100:00100000:0.0:1787548740.408817:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548740.408970:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416144512 00000100:00100000:3.0:1787548740.408980:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416144512 00000100:00100000:3.0:1787548740.409045:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 115 00000100:00100000:3.0:1787548740.409054:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:10552:x1874380416144512:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787548740.409113:0:5855:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787548740.409248:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:10552:x1874380416144512:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 Request processed in 183us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548740.409257:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 115 00000100:00100000:1.0:1787548740.415254:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548740.415366:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416144768 00000100:00100000:2.0:1787548740.415377:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416144768 00000100:00100000:2.0:1787548740.415433:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 116 00000100:00100000:2.0:1787548740.415443:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:10552:x1874380416144768:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787548740.415463:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548740.415466:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787548740.415492:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424efdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2371 expref: 56 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.415528:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:2.0:1787548740.415533:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787548740.415545:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f04b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2394 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787548740.415963:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787548740.416218:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f052 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.416231:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.416240:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.416290:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f04b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2394 expref: 58 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.416326:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2394 expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.416335:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fec87ceb400) 00010000:00010000:2.0:1787548740.416338:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548740.416341:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6c00, rc 0) 00000100:00100000:2.0:1787548740.416392:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:10552:x1874380416144768:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 951us (1147us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787548740.416401:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 116 00000100:00100000:1.0:1787548740.424626:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548740.424708:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416145024 00000100:00100000:2.0:1787548740.424717:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416145024 00000100:00100000:2.0:1787548740.424781:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 117 00000100:00100000:2.0:1787548740.424789:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:10552:x1874380416145024:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787548740.424847:0:8467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548740.424880:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f052 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2394 expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.424898:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fec87ceb400) 00010000:00010000:2.0:1787548740.424908:0:8467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787548740.424927:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f060 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.424945:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f060 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.424953:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f060 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425023:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f067 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf7de19f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425031:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7de19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425037:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7de19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425107:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f060 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425114:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f060 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425121:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f060 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425127:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548740.425167:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f060 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425175:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f060 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425184:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:2.0:1787548740.425187:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548740.425191:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f060 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425198:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f060 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425218:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7de19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425224:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f067 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7de19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425229:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f067 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7de19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425234:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548740.425237:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f067 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7de19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425243:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f067 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7de19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425251:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf7de19f (ffff8fec87ceb800) 00010000:00010000:2.0:1787548740.425254:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548740.425256:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f067 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf7de19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.425262:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f067 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf7de19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548740.425484:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:10552:x1874380416145024:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 693us (864us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787548740.425492:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 117 00000100:00100000:0.0:1787548740.431049:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548740.431321:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416145152 00000100:00100000:2.0:1787548740.431330:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416145152 00000100:00100000:2.0:1787548740.431385:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 118 00000100:00100000:2.0:1787548740.431394:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:10552:x1874380416145152:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787548740.431415:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548740.431451:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f06e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a239b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.431488:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f075 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.431501:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.431511:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.431600:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f06e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a239b expref: 58 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.431617:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a239b expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.431624:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:2.0:1787548740.431627:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787548740.431630:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ec400, rc 0) 00000100:00100000:2.0:1787548740.431695:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:10552:x1874380416145152:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 300us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548740.431702:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 118 00000100:00100000:1.0:1787548740.445717:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548740.445832:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416145408 00000100:00100000:0.0:1787548740.445842:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416145408 00000100:00100000:0.0:1787548740.445907:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 119 00000100:00100000:0.0:1787548740.445918:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:10552:x1874380416145408:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787548740.446001:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f07c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.446018:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f07c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.446029:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f07c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787548740.446400:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1787548740.446483:0:8467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f8a08ff reply state 00000000269050f2 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f07c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548740.446504:0:8467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787548740.446594:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+59:10552:x1874380416145408:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 678us (887us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787548740.446601:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 119 00000100:00100000:3.0:1787548740.453931:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548740.454519:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416145536 00000100:00100000:0.0:1787548740.454533:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416145536 00000100:00100000:0.0:1787548740.454731:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 120 00000100:00100000:0.0:1787548740.454743:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcefb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+59:10552:x1874380416145536:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787548740.454778:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548740.454804:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f083 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a23a2 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.454954:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f083 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23a2 expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.454973:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f083 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23a2 expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.454997:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:0.0:1787548740.455000:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787548740.455006:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150e00, rc 0) 00010000:00010000:2.0:1787548740.458984:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f07c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.459011:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f07c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.459021:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f07c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.459050:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548740.459055:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f07c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.459063:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f07c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.459171:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:2.0:1787548740.459175:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787548740.459182:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f07c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.459189:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f07c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548740.459722:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcefb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+59:10552:x1874380416145536:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 4971us (5795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548740.459734:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 120 00000100:00100000:1.0:1787548740.467618:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548740.467713:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416145664 00000100:00100000:3.0:1787548740.467727:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416145664 00000100:00080000:1.0:1787548740.467906:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787548740.469219:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 37 00000100:00100000:0.0:1787548740.469247:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2351:x1874380416145664:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787548740.470657:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2351:x1874380416145664:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 Request processed in 1414us (3530us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787548740.471691:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 37 00000100:00100000:1.0:1787548740.481841:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548740.482088:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416145920 00000100:00100000:3.0:1787548740.482101:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416145920 00000100:00100000:3.0:1787548740.482221:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 30 00000100:00100000:3.0:1787548740.482234:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+59:10552:x1874380416145920:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787548740.482577:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:10552:x1874380416145920:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 Request processed in 344us (761us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787548740.482585:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 30 00000100:00100000:3.0:1787548740.488278:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548740.488458:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416146176 00000100:00100000:1.0:1787548740.488472:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416146176 00000100:00100000:1.0:1787548740.488539:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 121 00000100:00100000:1.0:1787548740.488905:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:10552:x1874380416146176:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787548740.489062:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:10552:x1874380416146176:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 163us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548740.489070:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 121 00000100:00100000:1.0:1787548740.498192:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548740.498334:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416146304 00000100:00100000:3.0:1787548740.498347:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416146304 00000100:00100000:3.0:1787548740.498412:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 122 00000100:00100000:3.0:1787548740.498422:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:10552:x1874380416146304:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787548740.498453:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548740.498476:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424f08a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a23a9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.498563:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f091 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.498579:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.498608:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548740.498653:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548740.498682:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.498709:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424f08a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23a9 expref: 62 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.498728:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23a9 expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.498737:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:3.0:1787548740.498740:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787548740.498744:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93400, rc 0) 00000100:00100000:3.0:1787548740.498852:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:10552:x1874380416146304:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 431us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548740.498859:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 122 00000100:00100000:3.0:1787548740.506700:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548740.508739:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416146432 00000100:00100000:2.0:1787548740.508760:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416146432 00000100:00100000:2.0:1787548740.508859:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 38 00000100:00100000:2.0:1787548740.508872:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2352:x1874380416146432:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787548740.508896:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548740.508921:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424f098 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a23b0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787548740.508957:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8bd445, blocks: 0x1 00010000:00010000:2.0:1787548740.508979:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1787548740.508984:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548740.508995:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424f098 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b0 expref: 10 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.509039:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424f098 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b0 expref: 10 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.509055:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ed200, rc 0) 00000100:00100000:2.0:1787548740.509391:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:2352:x1874380416146432:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 520us (2706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548740.509399:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 38 00000100:00100000:1.0:1787548740.530227:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548740.530706:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416146688 00000100:00100000:3.0:1787548740.530728:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416146688 00000100:00100000:3.0:1787548740.530809:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 123 00000100:00100000:3.0:1787548740.530821:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:10552:x1874380416146688:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787548740.530970:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:10552:x1874380416146688:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 150us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548740.530979:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 123 00000100:00100000:0.0:1787548740.541256:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548740.541513:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416146816 00000100:00100000:2.0:1787548740.541526:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416146816 00000100:00100000:2.0:1787548740.541767:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 39 00000100:00100000:2.0:1787548740.541781:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:10552:x1874380416146816:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787548740.541807:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548740.541839:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f09f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a23b7 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.541882:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424f098 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b0 expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.541892:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548740.541898:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548740.541904:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f09f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b7 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.541953:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424f098 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b0 expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.541990:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424f098 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b0 expref: 11 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548740.542009:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5124e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1874380431884288:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548740.542178:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec91c65c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787548740.551596:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548740.551840:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416146944 00000100:00100000:3.0:1787548740.551852:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416146944 00010000:00010000:3.0:1787548740.551914:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424f098 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b0 expref: 12 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548740.551973:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 55 00000100:00100000:3.0:1787548740.551986:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:2352:x1874380416146944:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548740.552009:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548740.552042:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424f098 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b0 expref: 12 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.552060:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424f098 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b0 expref: 12 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548740.552081:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5124e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1874380431884288:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548740.552106:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a20f11d7/0xcb7c48919424f098 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b0 expref: 12 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.552125:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f09f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b7 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.552180:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548740.552187:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548740.552197:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f09f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b7 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.552210:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f09f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b7 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.554195:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21edc00, rc 0) 00000100:00100000:2.0:1787548740.554366:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+11:10552:x1874380416146816:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 12582us (13120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548740.554379:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 39 00010000:00010000:3.0:1787548740.555706:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f09f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b7 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548740.555773:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcef8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5840:1874380431884416:192.168.206.13@tcp:105: 00000100:00100000:3.0:1787548740.555894:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865e5180 going to sleep for 11 seconds 00000100:00100000:3.0:1787548740.559225:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcef8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5840:1874380431884416:192.168.206.13@tcp:105: 00010000:00010000:3.0:1787548740.559269:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548740.559329:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:2352:x1874380416146944:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 7345us (7749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548740.559341:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 55 00000100:00100000:1.0:1787548740.568490:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548740.568703:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416147072 00000100:00100000:2.0:1787548740.568725:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416147072 00002000:00100000:2.0:1787548740.568788:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8fecb515c380 x1874380416147072/t0(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:181/0 lens 504/0 e 0 to 0 dl 1787548751 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787548740.568811:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fecb515c380 with x1874380416147072 ext(0->12) 00002000:00010000:2.0:1787548740.568819:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fecb515c380 00000100:00100000:2.0:1787548740.568855:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 2 00000100:00100000:2.0:1787548740.568867:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:2351:x1874380416147072:12345-192.168.206.13@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787548740.569489:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:2351:x1874380416147072:12345-192.168.206.13@tcp:4:lhsmtool_posix.0 Request processed in 622us (1012us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787548740.569504:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 2 00002000:00100000:2.0:1787548740.569512:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8fecb515c380 x1874380416147072/t4294967308(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:181/0 lens 504/448 e 0 to 0 dl 1787548751 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787548740.569522:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fecb515c380 with x1874380416147072 ext(0->12) 00002000:00010000:2.0:1787548740.569526:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fecb515c380 00000100:00100000:0.0:1787548740.578000:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548740.578170:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416147200 00000100:00100000:3.0:1787548740.578184:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416147200 00000100:00100000:3.0:1787548740.578273:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 124 00000100:00100000:3.0:1787548740.578285:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:10552:x1874380416147200:12345-192.168.206.13@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787548740.697073:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1787548740.697096:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1787548740.697178:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787548740.697199:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8feca2df1e40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787548740.697204:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fecace7c500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fec8a928f00 00000020:00080000:0.0:1787548740.697207:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fecace7cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fecb511f800 00000001:00080000:0.0:1787548740.697225:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1787548740.697239:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:0.0:1787548740.697250:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787548740.697265:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fecace21180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787548740.697268:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fec925fcc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fecace216c0 00000020:00080000:0.0:1787548740.697270:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fec863f8b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fecad539000 00000020:00080000:0.0:1787548740.697435:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787548740.697594:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787548740.697613:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431884544:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787548740.697691:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548740.697754:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787548740.697761:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431884672:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787548740.697785:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548740.697819:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431884544 00000100:00100000:0.0:1787548740.697840:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431884544 00000100:00100000:1.0:1787548740.698049:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:10552:x1874380416147200:12345-192.168.206.13@tcp:44:lhsmtool_posix.0 Request processed in 119763us (120061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548740.698060:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 124 00000100:00100000:3.0:1787548740.699047:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431884672 00000100:00100000:3.0:1787548740.699055:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431884672 00000100:00100000:3.0:1787548740.699102:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787548740.699112:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874380431884672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787548740.699150:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1787548740.699182:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8bd443, atime: 0x6a8bd443, ctime: 0x6a8bd443, blocks: 0x1 00010000:00010000:3.0:1787548740.699189:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e14b750/0xcb7c48919424f0a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.699204:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1787548740.699209:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548740.699215:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e14b750/0xcb7c48919424f0a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.699246:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e14b750/0xcb7c48919424f0a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.699258:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e14b750/0xcb7c48919424f0a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.699266:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e14b750/0xcb7c48919424f0a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.699284:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787548740.699784:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1874380431884672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 672us (1995us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787548740.699792:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1787548740.699826:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548740.699832:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e14b750/0xcb7c48919424f0a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.699840:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93600 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548740.699844:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e14b750/0xcb7c48919424f0a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.699931:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e14b750/0xcb7c48919424f0a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.699949:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e14b750/0xcb7c48919424f0a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.699963:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e14b750/0xcb7c48919424f0a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.699983:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548740.699985:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548740.699987:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548740.700158:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787548740.700168:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874380431884544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787548740.700186:0:10297:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1787548740.700202:0:10297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f0ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.700217:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074729d12/0xcb7c48919424ee68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2316 expref: 11 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.700225:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787548740.700229:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787548740.700233:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f0ad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.700264:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074729d12/0xcb7c48919424ee68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2316 expref: 11 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.700279:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074729d12/0xcb7c48919424ee68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2316 expref: 11 pid: 6692 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548740.700294:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10297:1874380431884800:192.168.206.13@tcp:104: 00000100:00100000:0.0:1787548740.700354:0:10297:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8640df00 going to sleep for 11 seconds 00000004:00080000:0.0:1787548740.700389:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fecad57f800/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787548740.700396:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431884672:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787548740.701211:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548740.701546:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416147328 00000100:00100000:3.0:1787548740.701553:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416147328 00000100:00100000:3.0:1787548740.701704:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 42 00000100:00100000:3.0:1787548740.701713:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:2352:x1874380416147328:12345-192.168.206.13@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787548740.710621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548740.710653:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416147456 00000100:00100000:3.0:1787548740.710673:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416147456 00010000:00010000:3.0:1787548740.710708:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074729d12/0xcb7c48919424ee68 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2316 expref: 13 pid: 6692 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548740.710743:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 56 00000100:00100000:3.0:1787548740.710752:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:2351:x1874380416147456:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548740.710765:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548740.710771:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074729d12/0xcb7c48919424ee68 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2316 expref: 13 pid: 6692 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.710784:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074729d12/0xcb7c48919424ee68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2316 expref: 13 pid: 6692 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.710830:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787548740.710835:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787548740.710840:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f0ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.710979:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f0ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.711002:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548740.711051:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:2351:x1874380416147456:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 299us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548740.711058:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 56 00010000:00010000:0.0:1787548740.713733:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074729d12/0xcb7c48919424ee68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2316 expref: 12 pid: 6692 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548740.713755:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10297:1874380431884800:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548740.713777:0:10297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f0ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.713787:0:10297:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f0ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.713795:0:10297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f0ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.713805:0:10297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f0ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.713812:0:10297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f0ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.713829:0:10297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787548740.714408:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1874380431884544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14239us (16714us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787548740.714418:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1787548740.714466:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fecad57fb80/2, rc 0, transno 4294967309 00000100:00100000:0.0:1787548740.714477:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431884544:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787548740.714944:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548740.714952:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f0ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.714962:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548740.714967:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f0ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.714978:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f0ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.715012:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f0ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.715019:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f0ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.715038:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548740.715040:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548740.715042:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787548740.802598:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1787548740.802613:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1787548740.802620:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1787548740.803422:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416147328:12345-192.168.206.13@tcp:16:lhsmtool_posix.0 Request processed in 101702us (102206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548740.803434:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 42 00000100:00100000:3.0:1787548740.810219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548740.810567:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416147712 00000100:00100000:1.0:1787548740.810578:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416147712 00000100:00100000:1.0:1787548740.810645:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 125 00000100:00100000:1.0:1787548740.810657:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:10552:x1874380416147712:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787548740.810721:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548740.810747:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f091 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23a9 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.810767:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:1.0:1787548740.810772:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787548740.810803:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f0b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.810826:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.810850:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787548740.811092:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006cd00867 reply state 00000000b4ccbe8a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548740.811102:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787548740.812204:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:10552:x1874380416147712:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 1543us (1987us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787548740.812214:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 125 00010000:00010000:2.0:1787548740.815059:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.815078:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f0b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.815086:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f0b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.815092:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548740.815097:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f0b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.815105:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f0b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.815121:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:2.0:1787548740.815125:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548740.815170:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f0b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.815196:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f0b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548740.815596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548740.815780:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416147840 00000100:00100000:2.0:1787548740.815790:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416147840 00000100:00100000:2.0:1787548740.815855:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 43 00000100:00100000:2.0:1787548740.815865:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416147840:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787548740.816065:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787548740.816069:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787548740 00002000:00010000:2.0:1787548740.816072:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787548739 00002000:00010000:2.0:1787548740.816073:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787548741 -> 1787548740 00002000:00010000:2.0:1787548740.816076:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787548740.816151:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2352:x1874380416147840:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 Request processed in 265us (537us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787548740.816160:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 43 00000100:00100000:0.0:1787548740.819022:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548740.819212:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416148096 00000100:00100000:2.0:1787548740.819223:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416148096 00000100:00100000:3.0:1787548740.819482:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 126 00000100:00100000:3.0:1787548740.819498:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:10552:x1874380416148096:12345-192.168.206.13@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787548740.819607:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.819629:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f075 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a239b expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.819639:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.819695:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a239b expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.819723:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f075 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a239b expref: 15 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548740.819740:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcefa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1874380431884928:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548740.819873:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8a912c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787548740.823627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548740.823756:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416148224 00000100:00100000:1.0:1787548740.823769:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416148224 00010000:00010000:1.0:1787548740.823828:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f075 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a239b expref: 16 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548740.823875:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 57 00000100:00100000:1.0:1787548740.823887:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcefad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:2351:x1874380416148224:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548740.823906:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548740.823914:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f075 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a239b expref: 16 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.823931:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f075 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a239b expref: 16 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.823961:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:1.0:1787548740.823967:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.824004:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.824013:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.824038:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548740.824111:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcefad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:2351:x1874380416148224:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 226us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548740.824120:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 57 00010000:00010000:0.0:1787548740.824483:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f075 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a239b expref: 15 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548740.824507:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcefa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1874380431884928:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548740.824529:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.824538:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.824543:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.824568:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.824574:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.824581:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.824586:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548740.824590:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.824597:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.824612:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:0.0:1787548740.824614:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787548740.824633:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.824639:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f0bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548740.824730:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:10552:x1874380416148096:12345-192.168.206.13@tcp:55:lhsmtool_posix.0 Request processed in 5234us (5716us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787548740.824740:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 126 00000100:00100000:3.0:1787548740.834282:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548740.834620:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416148352 00000100:00100000:0.0:1787548740.834635:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416148352 00000100:00100000:0.0:1787548740.834731:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 44 00000100:00100000:0.0:1787548740.834742:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2352:x1874380416148352:12345-192.168.206.13@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787548740.834799:0:10297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000095765f25/0xcb7c48919424f0c2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.834820:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f09f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b7 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.834829:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787548740.834833:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787548740.834838:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095765f25/0xcb7c48919424f0c2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.834872:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f09f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b7 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.834886:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f09f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b7 expref: 7 pid: 6691 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548740.834914:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10297:1874380431885056:192.168.206.13@tcp:104: 00000100:00100000:0.0:1787548740.834999:0:10297:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865e5240 going to sleep for 11 seconds 00000100:00100000:0.0:1787548740.839006:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10297:1874380431885056:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548740.839038:0:10297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000095765f25/0xcb7c48919424f0c2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548740.841694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548740.841795:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416148480 00000100:00100000:2.0:1787548740.841810:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416148480 00010000:00010000:2.0:1787548740.841855:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f09f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b7 expref: 8 pid: 6691 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548740.841901:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 58 00000100:00100000:2.0:1787548740.841911:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2351:x1874380416148480:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548740.841925:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548740.841947:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f09f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b7 expref: 8 pid: 6691 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.841975:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f09f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b7 expref: 8 pid: 6691 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.841999:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f09f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23b7 expref: 8 pid: 6691 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.842016:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787548740.842020:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787548740.842026:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000095765f25/0xcb7c48919424f0c2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.842036:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095765f25/0xcb7c48919424f0c2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.842073:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548740.842181:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2351:x1874380416148480:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 272us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548740.842189:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 58 00010000:00010000:0.0:1787548740.842555:0:10297:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000095765f25/0xcb7c48919424f0c2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.842567:0:10297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095765f25/0xcb7c48919424f0c2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.842594:0:10297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000095765f25/0xcb7c48919424f0c2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.842602:0:10297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095765f25/0xcb7c48919424f0c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.842610:0:10297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095765f25/0xcb7c48919424f0c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.842617:0:10297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150c00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548740.842621:0:10297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095765f25/0xcb7c48919424f0c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.842643:0:10297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095765f25/0xcb7c48919424f0c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.842656:0:10297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095765f25/0xcb7c48919424f0c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.842676:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095765f25/0xcb7c48919424f0c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548740.842746:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416148352:12345-192.168.206.13@tcp:1:lhsmtool_posix.0 Request processed in 8005us (8489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548740.842756:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 44 00000100:00100000:2.0:1787548740.850718:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548740.851025:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416148736 00000100:00100000:0.0:1787548740.851041:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416148736 00000100:00100000:0.0:1787548740.851116:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 127 00000100:00100000:0.0:1787548740.851128:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:10552:x1874380416148736:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787548740.851234:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f0c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.851250:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.851261:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.851462:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.851487:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f083 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23a2 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.851496:0:8467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.851527:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f083 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23a2 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.851542:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f083 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23a2 expref: 15 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548740.851555:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431885184:192.168.206.13@tcp:104: 00000100:00100000:0.0:1787548740.852930:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865e5240 going to sleep for 11 seconds 00000100:00100000:2.0:1787548740.858614:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548740.859188:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431885184:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548740.859214:0:8467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548740.859492:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416148864 00000100:00100000:1.0:1787548740.859512:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416148864 00010000:00010000:1.0:1787548740.859571:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f083 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23a2 expref: 16 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548740.859619:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 59 00000100:00100000:1.0:1787548740.859630:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5124380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:2351:x1874380416148864:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548740.859649:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548740.859656:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f083 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23a2 expref: 16 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.859683:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f083 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23a2 expref: 16 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.859709:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f083 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23a2 expref: 16 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.859752:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:1.0:1787548740.859758:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.859768:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.859776:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.859807:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548740.859945:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5124380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:2351:x1874380416148864:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 316us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548740.859954:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 59 00010000:00010000:0.0:1787548740.859986:0:8467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.859999:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787548740.860209:0:8467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1787548740.860352:0:8467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1787548740.861541:0:8467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1787548740.861976:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8467:1874380431885312:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787548740.862467:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548740.862504:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787548740.862549:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431885312 00000100:00100000:3.0:1787548740.862564:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431885312 00000100:00100000:3.0:1787548740.862641:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787548740.862653:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8467:x1874380431885312:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787548740.862812:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8467:x1874380431885312:12345-0@lo:1000:mdt00_003.0 Request processed in 161us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548740.862821:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787548740.862947:0:8467:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1787548740.862954:0:8467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1787548740.862974:0:8467:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8fecad57fb80 x1874380431884544/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787548756 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548740.862985:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8467:1874380431885312:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787548740.863492:0:8467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787548740.863572:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb515d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8467:1874380431885440:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787548740.863617:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548740.863636:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865e5240 going to sleep for 11 seconds 00000100:00100000:3.0:1787548740.863838:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431885440 00000100:00100000:3.0:1787548740.863845:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431885440 00000100:00100000:3.0:1787548740.863884:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787548740.863894:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8467:x1874380431885440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787548740.864076:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8467:x1874380431885440:12345-0@lo:1000:mdt00_003.0 Request processed in 183us (457us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787548740.864083:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787548740.864577:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb515d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8467:1874380431885440:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787548740.864616:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864642:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864649:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864656:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548740.864670:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864678:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864694:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:1.0:1787548740.864697:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787548740.864702:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864708:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f0d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864738:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f013 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864744:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f013 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864750:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f013 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864754:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548740.864763:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f013 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864768:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f013 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864777:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:1.0:1787548740.864779:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787548740.864785:0:8467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e000/0xcb7c48919424f01a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2386 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864795:0:8467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e000/0xcb7c48919424f01a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2386 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864803:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e000/0xcb7c48919424f01a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2386 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548740.864853:0:8467:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e000/0xcb7c48919424f01a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2386 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548740.864866:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcdf9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431885568:192.168.206.13@tcp:105: 00000100:00100000:1.0:1787548740.864922:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865e5240 going to sleep for 11 seconds 00000100:00100000:0.0:1787548740.871884:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcdf9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431885568:192.168.206.13@tcp:105: 00010000:00010000:0.0:1787548740.871924:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f013 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.871936:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f013 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.871979:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f0d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.871994:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f0d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872008:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f0d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872021:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f0d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872028:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f0d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872035:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f0d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872041:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548740.872045:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f0d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872054:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f0d7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872086:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:0.0:1787548740.872089:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548740.872093:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f0d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872100:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f0d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872111:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872117:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f0c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872123:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f0c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872150:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548740.872154:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f0c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872162:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f0c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872172:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:0.0:1787548740.872175:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787548740.872179:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f0c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.872185:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f0c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548740.872532:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:10552:x1874380416148736:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 21403us (21824us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787548740.872544:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 127 00000020:00080000:0.0:1787548740.872551:0:8467:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787548740.872641:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787548740.872650:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787548740.872795:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000040:00080000:1.0:1787548740.873183:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787548740.873193:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787548740.875521:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416148992 00000100:00100000:0.0:1787548740.875542:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416148992 00000100:00100000:0.0:1787548740.875629:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 31 00000100:00100000:0.0:1787548740.875642:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:10551:x1874380416148992:12345-192.168.206.13@tcp:49:lfs.0 00000100:00100000:0.0:1787548740.875839:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:10551:x1874380416148992:12345-192.168.206.13@tcp:49:lfs.0 Request processed in 198us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548740.875849:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 31 00000100:00100000:2.0:1787548740.876242:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548740.876449:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416149248 00000100:00100000:0.0:1787548740.876456:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416149248 00000100:00100000:0.0:1787548740.876489:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 32 00000100:00100000:0.0:1787548740.876497:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca6f16050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:10552:x1874380416149248:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787548740.882740:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787548740.882881:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787548740.882979:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f0de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.882999:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f0de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.883013:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f0de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.883023:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f0de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.883039:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f0de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.883046:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f0de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548740.883078:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787548740.883194:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548740.883203:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f0de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.883234:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548740.883239:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f0de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.883248:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f0de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.883265:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:2.0:1787548740.883268:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787548740.883273:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f0de lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.883279:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f0de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.883300:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548740.883302:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548740.883304:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548740.892883:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca6f16050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:10552:x1874380416149248:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 Request processed in 16368us (16625us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787548740.892903:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 32 00000020:00080000:0.0:1787548740.892914:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787548740.897120:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548740.897306:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416149504 00000100:00100000:1.0:1787548740.897320:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416149504 00000100:00100000:1.0:1787548740.897395:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 128 00000100:00100000:1.0:1787548740.897428:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:10551:x1874380416149504:12345-192.168.206.13@tcp:58:lfs.0 00000040:00080000:1.0:1787548740.898072:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787548740.898198:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:10551:x1874380416149504:12345-192.168.206.13@tcp:58:lfs.0 Request processed in 773us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548740.898272:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 128 00000100:00100000:1.0:1787548740.952217:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548740.952338:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416149632 00000100:00100000:3.0:1787548740.952351:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416149632 00000100:00100000:3.0:1787548740.952421:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 129 00000100:00100000:3.0:1787548740.952433:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:10554:x1874380416149632:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548740.952486:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548740.952514:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424f0e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a23be expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.952600:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f0ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.952617:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f0ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.952630:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f0ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.952647:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f0f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.952654:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.952670:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.953051:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424f0fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.953069:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a237f expref: 21 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.953078:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424f0fa lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.953123:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a237f expref: 21 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.953197:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a237f expref: 21 pid: 8467 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548740.953216:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1874380431885696:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548740.953342:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec988b7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787548740.959331:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548740.959740:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416149888 00000100:00100000:2.0:1787548740.959754:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416149888 00000100:00100000:2.0:1787548740.959831:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 33 00000100:00100000:2.0:1787548740.959843:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+22:5593:x1874380416149888:12345-192.168.206.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787548740.960221:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+23:5593:x1874380416149888:12345-192.168.206.13@tcp:35:ldlm_bl.0 Request processed in 377us (901us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787548740.960230:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 33 00000100:00100000:1.0:1787548740.960465:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1874380431885696:192.168.206.13@tcp:104: 00010000:00010000:1.0:1787548740.960499:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424f0fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548740.963378:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548740.963485:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416150016 00000100:00100000:3.0:1787548740.963500:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416150016 00010000:00010000:3.0:1787548740.963553:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a237f expref: 23 pid: 8467 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548740.963641:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 60 00000100:00100000:3.0:1787548740.963654:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+23:2352:x1874380416150016:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548740.963682:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548740.963703:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a237f expref: 23 pid: 8467 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.963720:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a237f expref: 23 pid: 8467 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.963747:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f005 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a237f expref: 23 pid: 8467 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.963767:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:3.0:1787548740.963773:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424f0fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.963800:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424f0fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.963808:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424f0fa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548740.963850:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548740.963926:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+22:2352:x1874380416150016:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 274us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548740.963935:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 60 00010000:00010000:2.0:1787548740.965289:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424f0fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965323:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424f0fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548740.965383:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787548740.965389:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548740.965418:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424f0fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965436:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424f0fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965448:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f0ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965455:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f0ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965462:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f0ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965469:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548740.965474:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f0ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965483:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f0ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965501:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:2.0:1787548740.965504:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548740.965509:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f0ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965527:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f0ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965545:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965551:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f0f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965557:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965562:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548740.965564:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965571:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f0f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965579:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fec90d93e00) 00010000:00010000:2.0:1787548740.965582:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548740.965585:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f0f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965590:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f0f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965638:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424f0e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23be expref: 22 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965652:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424f0fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23be expref: 21 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548740.965682:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:2.0:1787548740.965684:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548740.965688:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92600, rc 0) 00000100:00100000:2.0:1787548740.965772:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:10554:x1874380416149632:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 13341us (13571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548740.965782:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 129 00010000:00010000:2.0:1787548741.059418:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787548741.891399:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787548741.891413:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787548741.891478:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787548741.891488:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787548741.891790:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcdfb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874380431885824:192.168.206.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787548741.892423:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec811ca9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548741.899050:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548741.899094:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416150144 00000100:00100000:0.0:1787548741.899105:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416150144 00000100:00100000:0.0:1787548741.899190:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 130 00000100:00100000:0.0:1787548741.899203:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+22:10565:x1874380416150144:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787548741.899250:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787548741.899406:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+22:10565:x1874380416150144:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 Request processed in 205us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548741.899415:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 130 00000100:00100000:3.0:1787548741.899945:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcdfb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874380431885824:192.168.206.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787548741.917342:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548741.919686:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416150400 00000100:00100000:0.0:1787548741.919714:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416150400 00000100:00100000:0.0:1787548741.919794:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 131 00000100:00100000:0.0:1787548741.919806:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:10565:x1874380416150400:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787548741.919834:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548741.919861:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f101 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a23c5 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548741.920016:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f108 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548741.920034:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548741.920051:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548741.920064:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787548741.920259:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f101 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23c5 expref: 24 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548741.920280:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23c5 expref: 23 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548741.920290:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:0.0:1787548741.920294:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548741.920298:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151400, rc 0) 00000100:00100000:0.0:1787548741.920388:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+23:10565:x1874380416150400:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 583us (3339us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787548741.920396:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 131 00000100:00100000:0.0:1787548741.928579:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548741.928691:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548741.928877:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416150656 00000100:00100000:3.0:1787548741.928892:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416150656 00000100:00100000:3.0:1787548741.928970:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 132 00000100:00100000:3.0:1787548741.928981:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+23:10565:x1874380416150656:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787548741.929087:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f116 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548741.929108:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548741.929125:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548741.929618:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548741.929628:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f116 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548741.929670:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f116 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548741.929676:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548741.929681:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f116 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548741.929690:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f116 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548741.929775:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:3.0:1787548741.929779:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787548741.929784:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f116 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548741.929792:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f116 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548741.929994:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+24:10565:x1874380416150656:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 1011us (1299us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787548741.930004:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 132 00000040:00080000:3.0:1787548741.930200:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787548741.930206:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787548741.934809:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787548741.934835:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787548741.935165:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416150784 00000100:00100000:1.0:1787548741.935178:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416150784 00000100:00100000:1.0:1787548741.935270:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00100000:1.0:1787548741.935283:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+24:2354:x1874380416150784:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548741.935303:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548741.935349:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f108 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23c5 expref: 24 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548741.935372:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:1.0:1787548741.935389:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548741.935579:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+23:2354:x1874380416150784:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 298us (7014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548741.935589:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00100000:3.0:1787548741.952817:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548741.953249:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416151040 00000100:00100000:1.0:1787548741.953264:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416151040 00000100:00100000:1.0:1787548741.953340:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 34 00000100:00100000:1.0:1787548741.953352:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+23:10565:x1874380416151040:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787548741.953817:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+24:10565:x1874380416151040:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 Request processed in 465us (1011us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787548741.953827:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 34 00000040:00080000:2.0:1787548742.011180:0:12116:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787548742.011193:0:12116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787548742.011250:0:12116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787548742.011257:0:12116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787548742.085049:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548742.223936:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548742.224835:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416151296 00000100:00100000:3.0:1787548742.224850:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416151296 00000100:00100000:3.0:1787548742.224938:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 133 00000100:00100000:3.0:1787548742.224960:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+24:10578:x1874380416151296:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548742.224996:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548742.225022:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f11d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a23cc expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548742.225175:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424f124 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548742.225192:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424f124 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548742.225209:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424f124 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548742.225811:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787548742.225982:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f11d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23cc expref: 27 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548742.226001:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424f124 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23cc expref: 26 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548742.226010:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:3.0:1787548742.226014:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787548742.226017:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93600, rc 0) 00000100:00100000:3.0:1787548742.226102:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+26:10578:x1874380416151296:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 1146us (2180us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787548742.226111:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 133 00000100:00080000:0.0:1787548742.226346:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548742.235003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548742.235047:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416151424 00000100:00100000:3.0:1787548742.235065:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416151424 00000100:00100000:3.0:1787548742.235159:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 134 00000100:00100000:3.0:1787548742.235171:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+26:10578:x1874380416151424:12345-192.168.206.13@tcp:54:lfs.0 00010000:00010000:3.0:1787548742.235253:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f132 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548742.235274:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548742.235287:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548742.235337:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548742.235345:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f132 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548742.235354:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f132 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548742.235360:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548742.235366:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f132 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548742.235374:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f132 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548742.235390:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:3.0:1787548742.235393:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787548742.235399:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f132 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548742.235419:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f132 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548742.235504:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+26:10578:x1874380416151424:12345-192.168.206.13@tcp:54:lfs.0 Request processed in 335us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548742.235514:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 134 00000100:00100000:3.0:1787548742.332057:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548742.333954:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416151552 00000100:00100000:2.0:1787548742.333974:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416151552 00000100:00080000:0.0:1787548742.334155:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787548742.335199:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 45 00000100:00100000:2.0:1787548742.335226:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2353:x1874380416151552:12345-192.168.206.13@tcp:101:cat.0 00010000:00010000:2.0:1787548742.335252:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548742.335278:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f139 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a23d3 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787548742.335312:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8bd444, atime: 0x6a8bd443, ctime: 0x6a8bd444, blocks: 0xb 00010000:00010000:2.0:1787548742.335337:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1787548742.335342:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548742.335353:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f139 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23d3 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548742.335398:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f139 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23d3 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548742.335414:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21edc00, rc 0) 00000100:00100000:3.0:1787548742.335648:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2353:x1874380416151552:12345-192.168.206.13@tcp:101:cat.0 Request processed in 434us (3606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548742.335668:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 45 00000100:00100000:0.0:1787548742.351283:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548742.351415:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416151680 00000100:00100000:2.0:1787548742.351429:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416151680 00002000:00100000:2.0:1787548742.351494:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8fecad57d500 x1874380416151680/t0(0) o3->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:183/0 lens 488/0 e 0 to 0 dl 1787548753 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787548742.351507:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fecad57d500 with x1874380416151680 ext(0->4095) 00002000:00010000:2.0:1787548742.351515:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fecad57d500 00000100:00100000:2.0:1787548742.351554:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 3 00000100:00100000:2.0:1787548742.351565:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2354:x1874380416151680:12345-192.168.206.13@tcp:3:cat.0 00000100:00100000:2.0:1787548742.352795:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2354:x1874380416151680:12345-192.168.206.13@tcp:3:cat.0 Request processed in 1223us (1518us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787548742.352817:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 3 00002000:00100000:2.0:1787548742.352828:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8fecad57d500 x1874380416151680/t0(0) o3->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:183/0 lens 488/4536 e 0 to 0 dl 1787548753 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787548742.353976:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fecad57d500 with x1874380416151680 ext(0->4095) 00002000:00010000:2.0:1787548742.353987:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fecad57d500 00010000:00010000:1.0:1787548743.110002:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787548743.260450:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1787548743.260472:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1787548743.260482:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:0.0:1787548743.735421:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548743.735509:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548743.735544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548743.735571:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548743.735597:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548743.735635:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416152320 00000100:00100000:0.0:1787548743.735657:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416152320 00000100:00100000:0.0:1787548743.735735:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416151936 00000100:00100000:0.0:1787548743.735739:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416151936 00000100:00100000:0.0:1787548743.735765:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 129 00000100:00100000:0.0:1787548743.735777:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416152320:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548743.735877:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416152320:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 102us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548743.735887:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 129 00000100:00100000:0.0:1787548743.735921:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 130 00000100:00100000:0.0:1787548743.735929:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+26:2354:x1874380416151936:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548743.735958:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+26:2354:x1874380416151936:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 30us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548743.735966:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 130 00000100:00100000:0.0:1787548743.735998:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416152064 00000100:00100000:0.0:1787548743.736003:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416152064 00000100:00100000:0.0:1787548743.736031:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416152192 00000100:00100000:0.0:1787548743.736034:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416152192 00000100:00100000:0.0:1787548743.736069:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 59 00000100:00100000:0.0:1787548743.736078:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2354:x1874380416152064:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548743.736110:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2354:x1874380416152064:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 34us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548743.736157:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 59 00000100:00100000:0.0:1787548743.736173:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 60 00000100:00100000:0.0:1787548743.736181:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2354:x1874380416152192:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548743.736210:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2354:x1874380416152192:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 30us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548743.736217:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 60 00000100:00080000:0.0:1787548743.736237:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787548743.736243:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548743.737471:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416151808 00000100:00100000:2.0:1787548743.737482:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416151808 00000100:00100000:2.0:1787548743.737580:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 284 00000100:00100000:2.0:1787548743.737591:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2354:x1874380416151808:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548743.737672:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2354:x1874380416151808:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 83us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548743.737680:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 284 00010000:00010000:2.0:1787548744.131969:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548745.161169:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548745.219468:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcdf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431886080:0@lo:400:kworker.0 00000100:00100000:3.0:1787548745.219579:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548745.219660:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcdfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431886592:0@lo:400:kworker.0 00000100:00100000:3.0:1787548745.219693:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548745.219730:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787548745.219735:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcdf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431885952:0@lo:400:kworker.0 00000100:00100000:3.0:1787548745.219764:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548745.219785:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcdfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431886464:0@lo:400:kworker.0 00000100:00100000:3.0:1787548745.219805:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548745.219841:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431886592 00000100:00100000:3.0:1787548745.219850:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431886592 00000100:00100000:3.0:1787548745.219921:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787548745.219932:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1874380431886592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548745.219993:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1874380431886592:12345-0@lo:400:kworker.0 Request processed in 62us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548745.220023:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787548745.220053:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431885952 00000100:00100000:3.0:1787548745.220057:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431885952 00000100:00100000:3.0:1787548745.220086:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787548745.220094:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec85042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3316:x1874380431885952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548745.220126:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec85042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3316:x1874380431885952:12345-0@lo:400:kworker.0 Request processed in 33us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548745.220168:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787548745.220199:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431886080 00000100:00100000:3.0:1787548745.220202:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431886080 00000100:00100000:3.0:1787548745.220227:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431886464 00000100:00100000:3.0:1787548745.220231:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431886464 00000100:00100000:3.0:1787548745.220253:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787548745.220260:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcefad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431886080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548745.220290:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcefad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431886080:12345-0@lo:400:kworker.0 Request processed in 31us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548745.220296:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787548745.220306:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787548745.220311:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431886464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548745.220335:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431886464:12345-0@lo:400:kworker.0 Request processed in 24us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548745.220340:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1787548745.220356:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787548745.220361:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787548745.220401:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcdf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431885952:0@lo:400:kworker.0 00000100:00100000:3.0:1787548745.220416:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcdfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431886464:0@lo:400:kworker.0 00000100:00100000:3.0:1787548745.220437:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcdf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431886080:0@lo:400:kworker.0 00000100:00100000:3.0:1787548745.220447:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcdfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431886592:0@lo:400:kworker.0 00000100:00100000:0.0:1787548745.220857:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcdf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431886208:0@lo:400:kworker.0 00000100:00100000:0.0:1787548745.220925:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548745.220958:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787548745.220964:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcdfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431886336:0@lo:400:kworker.0 00000100:00100000:0.0:1787548745.220991:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548745.221048:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431886336 00000100:00100000:0.0:1787548745.221053:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431886336 00000100:00100000:0.0:1787548745.221103:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787548745.221112:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431886336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548745.221172:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431886336:12345-0@lo:400:kworker.0 Request processed in 62us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548745.221179:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787548745.221212:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787548745.221218:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1787548745.221244:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fecad57f800, transno 4294967304 00000100:00100000:0.0:1787548745.221256:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcdfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431886336:0@lo:400:kworker.0 00000100:00100000:1.0:1787548745.221675:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431886208 00000100:00100000:1.0:1787548745.221682:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431886208 00000100:00100000:1.0:1787548745.221737:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787548745.221745:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431886208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548745.221795:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431886208:12345-0@lo:400:kworker.0 Request processed in 51us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548745.221801:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787548745.221829:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcdf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431886208:0@lo:400:kworker.0 00000100:00080000:3.0:1787548745.222101:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787548745.222107:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787548745.224833:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431886720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787548745.224930:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548745.225007:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431886720 00000100:00100000:2.0:1787548745.225017:0:11969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431886720 00000100:00100000:2.0:1787548745.225081:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787548745.225092:0:11969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431886720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787548745.225154:0:11969:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548745.225206:0:11969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431886720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548745.225214:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787548745.225268:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca71da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431886720:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1787548745.226934:0:8095:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368103800851ns, next at 369103797033ns, rc = 0 00000100:00100000:3.0:1787548745.226997:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787548745.227020:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcdf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431886848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548745.227099:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548745.227283:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431886848 00000100:00100000:1.0:1787548745.227301:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431886848 00000100:00100000:1.0:1787548745.227360:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787548745.227370:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874380431886848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787548745.227409:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548745.227462:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874380431886848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548745.227469:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787548745.227676:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcdf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431886848:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787548745.835396:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:0.0:1787548745.835447:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000004:00080000:0.0:1787548745.835463:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:0.0:1787548745.835475:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:0.0:1787548745.835485:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fecace21240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787548745.835490:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8feca7696a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fecace216c0 00000020:00080000:0.0:1787548745.835493:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8feca7696800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8feb81862800 00000001:00080000:0.0:1787548745.835507:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1787548745.835525:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787548745.835780:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1787548745.835885:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcb3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431886976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787548745.835982:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548745.836833:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431886976 00000100:00100000:3.0:1787548745.836847:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431886976 00000100:00100000:3.0:1787548745.836919:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787548745.836931:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1874380431886976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787548745.837352:0:10297:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787548745.837357:0:10297:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787548740 -> 1787548740 00002000:00010000:3.0:1787548745.837360:0:10297:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1787548739 -> 1787548739 00002000:00010000:3.0:1787548745.837362:0:10297:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787548740 -> 1787548740 00002000:00010000:3.0:1787548745.837365:0:10297:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787548745.837447:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3315:x1874380431886976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 518us (1464us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787548745.837456:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:2.0:1787548745.837800:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fecbcb3f800/2, rc 0, transno 4294967312 00000100:00100000:2.0:1787548745.837810:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcb3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431886976:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1787548745.839967:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1787548745.839993:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1787548745.840003:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:1.0:1787548746.182257:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787548747.079018:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787548747.079028:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787548747.079688:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787548747.079699:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787548747.203343:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548747.759944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548747.760378:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416152448 00000100:00100000:3.0:1787548747.760393:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416152448 00000100:00100000:3.0:1787548747.760497:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 135 00000100:00100000:3.0:1787548747.760512:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:10231:x1874380416152448:12345-192.168.206.13@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1787548747.760571:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548747.760679:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:10231:x1874380416152448:12345-192.168.206.13@tcp:60:lhsmtool_posix.0 Request processed in 171us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548747.760706:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 135 00000100:00100000:0.0:1787548747.775310:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548747.777059:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416152704 00000100:00100000:1.0:1787548747.777081:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416152704 00000100:00100000:1.0:1787548747.777232:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 35 00000100:00100000:1.0:1787548747.777245:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:10231:x1874380416152704:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787548747.777918:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:10231:x1874380416152704:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 Request processed in 671us (2617us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787548747.777929:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 35 00000100:00100000:0.0:1787548748.013703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548748.014015:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416152832 00000100:00100000:3.0:1787548748.014030:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416152832 00000100:00100000:3.0:1787548748.014210:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 136 00000100:00100000:3.0:1787548748.014224:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+5:11030:x1874380416152832:12345-192.168.206.13@tcp:101:lsof.0 00010000:00010000:3.0:1787548748.014254:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548748.014291:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f140 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a23da expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548748.014399:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f147 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548748.014417:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548748.014431:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548748.014854:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787548748.014861:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548748.014978:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548748.015014:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f140 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23da expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548748.015035:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f147 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23da expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548748.015060:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:3.0:1787548748.015064:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787548748.015069:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92800, rc 0) 00000100:00100000:3.0:1787548748.015336:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+6:11030:x1874380416152832:12345-192.168.206.13@tcp:101:lsof.0 Request processed in 1103us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548748.015346:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 136 00000100:00080000:0.0:1787548748.015504:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787548748.227433:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548748.862842:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548748.864760:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548748.864819:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548748.864855:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548748.864917:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548748.864971:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416153216 00000100:00100000:3.0:1787548748.864984:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416153216 00000100:00100000:3.0:1787548748.865058:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416153344 00000100:00100000:3.0:1787548748.865062:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416153344 00000100:00100000:3.0:1787548748.865089:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 63 00000100:00100000:3.0:1787548748.865101:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416153216:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548748.865216:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416153216:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 117us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548748.865225:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 63 00000100:00100000:3.0:1787548748.865242:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 64 00000100:00100000:3.0:1787548748.865249:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416153344:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548748.865278:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416153344:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 29us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548748.865301:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 64 00000100:00080000:3.0:1787548748.865325:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787548748.865330:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787548748.865341:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416153472 00000100:00100000:3.0:1787548748.865345:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416153472 00000100:00100000:3.0:1787548748.865373:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416153088 00000100:00100000:3.0:1787548748.865377:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416153088 00000100:00100000:3.0:1787548748.865401:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 134 00000100:00100000:3.0:1787548748.865410:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92088e20-066b-499e-ac52-ab10992c506a+6:2351:x1874380416153472:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548748.865418:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 135 00000100:00100000:1.0:1787548748.865433:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:2351:x1874380416153088:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548748.865449:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92088e20-066b-499e-ac52-ab10992c506a+6:2351:x1874380416153472:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 40us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548748.865457:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 134 00000100:00100000:1.0:1787548748.865482:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:2351:x1874380416153088:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 53us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548748.865491:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 135 00000100:00100000:2.0:1787548748.868351:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416152960 00000100:00100000:2.0:1787548748.868378:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416152960 00000100:00100000:2.0:1787548748.868467:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 286 00000100:00100000:2.0:1787548748.868697:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2351:x1874380416152960:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548748.868896:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2351:x1874380416152960:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 204us (6068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548748.868905:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 286 00010000:00010000:1.0:1787548749.251449:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548750.277903:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548750.340967:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431887104:0@lo:400:kworker.0 00000100:00100000:0.0:1787548750.341066:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548750.341310:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431887104 00000100:00100000:3.0:1787548750.341335:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad6e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431887232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548750.341338:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431887104 00000100:00100000:3.0:1787548750.341374:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548750.341398:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787548750.341409:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3316:x1874380431887104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548750.341915:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431887360:0@lo:400:kworker.0 00000100:00100000:1.0:1787548750.341935:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3316:x1874380431887104:12345-0@lo:400:kworker.0 Request processed in 527us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548750.341944:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787548750.342021:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431887232 00000100:00100000:1.0:1787548750.342026:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431887232 00000100:00100000:1.0:1787548750.342071:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787548750.342079:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431887232:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548750.342090:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787548750.342119:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548750.342187:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431887232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548750.342193:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1787548750.342214:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548750.342260:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431887488:0@lo:400:kworker.0 00000100:00100000:3.0:1787548750.342265:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431887360 00000100:00100000:3.0:1787548750.342269:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431887360 00000100:00100000:1.0:1787548750.342289:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548750.342299:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431887488 00000100:00100000:3.0:1787548750.342302:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431887488 00000100:00100000:1.0:1787548750.342311:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787548750.342317:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcdfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431887616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548750.342328:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787548750.342334:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431887360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548750.342340:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548750.342365:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431887616 00000100:00100000:1.0:1787548750.342369:0:11969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431887616 00000100:00100000:3.0:1787548750.342371:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431887360:12345-0@lo:400:kworker.0 Request processed in 37us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548750.342377:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787548750.342390:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787548750.342393:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787548750.342399:0:11969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874380431887616:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548750.342404:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431887488:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787548750.342420:0:11969:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548750.342436:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431887488:12345-0@lo:400:kworker.0 Request processed in 32us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548750.342442:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787548750.342465:0:11969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874380431887616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548750.342480:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431887360:0@lo:400:kworker.0 00000100:00100000:1.0:1787548750.342480:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787548750.342515:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad6e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431887232:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787548750.342528:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787548750.342532:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787548750.342543:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1787548750.342550:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fecad57fb80, transno 4294967309 00000004:00080000:1.0:1787548750.342561:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:1.0:1787548750.342585:0:3315:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8fecbcb3f800 x1874380431886976/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787548761 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548750.342598:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcdfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431887616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548750.342622:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431887488:0@lo:400:kworker.0 00000100:00100000:2.0:1787548750.352286:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787548750.352320:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874380431887744:0@lo:400:kworker.0 00000100:00100000:2.0:1787548750.352416:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548750.352497:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431887744 00000100:00100000:2.0:1787548750.352507:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431887744 00000100:00100000:2.0:1787548750.352580:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787548750.352590:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874380431887744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548750.352662:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874380431887744:12345-0@lo:400:kworker.0 Request processed in 73us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548750.352670:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787548750.352720:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874380431887744:0@lo:400:kworker.0 00000100:00080000:2.0:1787548750.352748:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548750.353272:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431887104:0@lo:400:kworker.0 00000001:00080000:2.0:1787548750.928458:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000020:00080000:1.0:1787548750.929480:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1787548750.929506:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787548750.930083:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787548750.930097:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1787548751.306220:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787548752.112868:0:12317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:19:11 (1787548751) 00010000:00010000:2.0:1787548752.330272:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548753.351612:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548753.862933:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548753.863081:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416153728 00000100:00100000:0.0:1787548753.863095:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416153728 00000100:00100000:0.0:1787548753.863235:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 137 00000100:00100000:0.0:1787548753.863248:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:11295:x1874380416153728:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787548753.863293:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548753.863318:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f14e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a23e1 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.863407:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f155 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.863421:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f155 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.863435:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f155 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.863449:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f15c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.863456:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f15c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.863462:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f15c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787548753.863603:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787548753.865048:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f163 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865074:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f163 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865087:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f163 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548753.865102:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787548753.865388:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f155 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865396:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f155 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865404:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f155 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865410:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548753.865415:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f155 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865424:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f155 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865438:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fec90d93100) 00010000:00010000:0.0:1787548753.865442:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548753.865447:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f155 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865467:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f155 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865482:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f15c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865862:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f15c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865870:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f15c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865889:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548753.865893:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f15c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865900:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f15c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865910:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548753.865913:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548753.865916:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f15c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.865922:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f15c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.869847:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f14e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23e1 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.869897:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f163 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23e1 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548753.869910:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8feca2d51a00) 00010000:00010000:0.0:1787548753.869913:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548753.869917:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150800, rc 0) 00000100:00100000:0.0:1787548753.870036:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:11295:x1874380416153728:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 6789us (7116us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787548753.870048:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 137 00000100:00100000:1.0:1787548753.878295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548753.879350:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416153856 00000100:00100000:2.0:1787548753.879371:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416153856 00000100:00100000:2.0:1787548753.879469:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 138 00000100:00100000:2.0:1787548753.879482:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:11295:x1874380416153856:12345-192.168.206.13@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787548753.879649:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:11295:x1874380416153856:12345-192.168.206.13@tcp:59:lhsmtool_posix.0 Request processed in 169us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548753.879657:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 138 00000100:00100000:2.0:1787548753.888629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548753.888725:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416153984 00000100:00100000:3.0:1787548753.888746:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416153984 00000100:00100000:3.0:1787548753.888837:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:3.0:1787548753.888849:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:2353:x1874380416153984:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548753.888869:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548753.888913:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f163 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23e1 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548753.888937:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8feca2d51a00) 00010000:00010000:3.0:1787548753.888943:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548753.889022:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:2353:x1874380416153984:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 174us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548753.889030:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:3.0:1787548753.976677:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548753.976738:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548753.976781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548753.976823:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548753.976855:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416154112 00000100:00100000:3.0:1787548753.976867:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416154112 00000100:00100000:3.0:1787548753.976926:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 288 00000100:00100000:3.0:1787548753.976938:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2351:x1874380416154112:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548753.977044:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2351:x1874380416154112:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 108us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548753.977053:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 288 00000100:00100000:3.0:1787548753.977092:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416154240 00000100:00100000:3.0:1787548753.977095:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416154240 00000100:00100000:3.0:1787548753.977160:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416154368 00000100:00100000:3.0:1787548753.977164:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416154368 00000100:00100000:3.0:1787548753.977191:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 65 00000100:00100000:3.0:1787548753.977197:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416154240:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548753.977231:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416154240:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 34us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548753.977237:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 65 00000100:00100000:3.0:1787548753.977250:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 66 00000100:00100000:3.0:1787548753.977257:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416154368:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548753.977283:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416154368:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548753.977290:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 66 00000100:00100000:1.0:1787548753.977503:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416154496 00000100:00100000:1.0:1787548753.977508:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416154496 00000100:00100000:1.0:1787548753.977554:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 139 00000100:00100000:1.0:1787548753.977562:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+6:2351:x1874380416154496:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548753.977617:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+6:2351:x1874380416154496:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 57us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548753.977624:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 139 00000100:00080000:1.0:1787548753.977642:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787548753.977654:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787548753.977657:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787548754.247569:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787548754.247582:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787548754.248354:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787548754.248369:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787548754.374772:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548755.396174:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548755.460244:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431888000:0@lo:400:kworker.0 00000100:00100000:3.0:1787548755.460341:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548755.460408:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431888512:0@lo:400:kworker.0 00000100:00100000:3.0:1787548755.460445:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548755.460492:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787548755.460500:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431888128:0@lo:400:kworker.0 00000100:00100000:0.0:1787548755.460658:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431887872:0@lo:400:kworker.0 00000100:00100000:0.0:1787548755.460712:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548755.460759:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874380431888384:0@lo:400:kworker.0 00000100:00100000:0.0:1787548755.460807:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431887872 00000100:00100000:0.0:1787548755.460815:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431887872 00000100:00100000:0.0:1787548755.460875:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787548755.460886:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3314:x1874380431887872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548755.460962:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3314:x1874380431887872:12345-0@lo:400:kworker.0 Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548755.460971:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787548755.461232:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431888256:0@lo:400:kworker.0 00000100:00100000:2.0:1787548755.461281:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548755.461294:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcb3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431888640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787548755.461329:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431888000 00000100:00100000:2.0:1787548755.461334:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431888000 00000100:00100000:0.0:1787548755.461339:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548755.461382:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431888640 00000100:00100000:0.0:1787548755.461387:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431888640 00000100:00100000:2.0:1787548755.461392:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787548755.461403:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431888000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548755.461440:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787548755.461449:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431888000:12345-0@lo:400:kworker.0 Request processed in 48us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548755.461451:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431888640:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787548755.461463:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787548755.461490:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431888512 00000100:00100000:2.0:1787548755.461495:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431888512 00002000:00000024:0.0:1787548755.461496:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548755.461523:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431888256 00000100:00100000:2.0:1787548755.461528:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431888256 00000100:00100000:0.0:1787548755.461559:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874380431888640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548755.461563:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787548755.461572:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787548755.461577:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1874380431888512:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787548755.461608:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787548755.461615:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787548755.461627:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431888512:12345-0@lo:400:kworker.0 Request processed in 54us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548755.461636:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787548755.461651:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000100:00100000:2.0:1787548755.461652:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000004:00080000:0.0:1787548755.461660:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fecbcb3f800, transno 4294967312 00000100:00100000:2.0:1787548755.461664:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431888256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548755.461685:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcb3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431888640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787548755.461708:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431888256:12345-0@lo:400:kworker.0 Request processed in 46us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548755.461716:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787548755.461756:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431888256:0@lo:400:kworker.0 00000100:00100000:2.0:1787548755.461854:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431888768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787548755.461892:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548755.461927:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431888768 00000100:00100000:2.0:1787548755.461932:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431888768 00000100:00100000:2.0:1787548755.461958:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787548755.461966:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431888768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787548755.461988:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548755.462024:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431888768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548755.462031:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787548755.462059:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431888768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548755.462595:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548755.462653:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431888000:0@lo:400:kworker.0 00000100:00100000:3.0:1787548755.462665:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431888512:0@lo:400:kworker.0 00000100:00100000:0.0:1787548755.462875:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431888128 00000100:00100000:0.0:1787548755.462880:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431888128 00000100:00100000:0.0:1787548755.463351:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787548755.463362:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431888128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548755.463426:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431888128:12345-0@lo:400:kworker.0 Request processed in 66us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548755.463433:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1787548755.463906:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548755.464018:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431888128:0@lo:400:kworker.0 00000100:00100000:2.0:1787548755.464763:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548755.464833:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431887872:0@lo:400:kworker.0 00000100:00100000:3.0:1787548755.465728:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431888384 00000100:00100000:3.0:1787548755.465741:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431888384 00000100:00080000:0.0:1787548755.465809:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548755.465831:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787548755.465844:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874380431888384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548755.465952:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874380431888384:12345-0@lo:400:kworker.0 Request processed in 110us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548755.465961:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787548755.466045:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874380431888384:0@lo:400:kworker.0 00000100:00100000:3.0:1787548755.911665:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548755.912040:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416154624 00000100:00100000:0.0:1787548755.912050:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416154624 00000100:00100000:0.0:1787548755.912124:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 139 00000100:00100000:0.0:1787548755.912154:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:11337:x1874380416154624:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548755.912173:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548755.912193:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f171 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a23e8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787548755.912249:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787548755.912253:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f178 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912267:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912278:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912292:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f17f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912299:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912320:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912551:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912560:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f178 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912567:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912573:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548755.912577:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912596:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f178 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912609:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:0.0:1787548755.912612:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548755.912616:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912623:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912634:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912641:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f17f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912653:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f17f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912658:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548755.912661:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f17f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912668:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f17f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912676:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548755.912677:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548755.912680:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f17f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912684:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f17f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912714:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f171 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23e8 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912724:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:0.0:1787548755.912727:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548755.912730:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f171 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23e8 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548755.912739:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150200, rc 0) 00000100:00100000:0.0:1787548755.912799:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:11337:x1874380416154624:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 648us (1144us total) trans 0 rc 301/301 00000100:00100000:0.0:1787548755.912816:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 139 00000100:00100000:1.0:1787548755.923423:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548755.923470:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416154880 00000100:00100000:1.0:1787548755.923480:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416154880 00000100:00100000:1.0:1787548755.923529:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 140 00000100:00100000:1.0:1787548755.923538:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:11337:x1874380416154880:12345-192.168.206.13@tcp:36:lfs.0 00010000:00010000:1.0:1787548755.923602:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548755.923628:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424eaef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2221 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548755.923647:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:1.0:1787548755.923652:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787548755.927477:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548755.927504:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f147 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23da expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548755.927513:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548755.927549:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f147 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23da expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548755.927563:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f147 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23da expref: 5 pid: 5856 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548755.927603:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcdf8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431888896:192.168.206.13@tcp:104: 00000100:00100000:1.0:1787548755.928250:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec600 going to sleep for 11 seconds 00000100:00100000:1.0:1787548755.931738:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcdf8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431888896:192.168.206.13@tcp:104: 00010000:00010000:1.0:1787548755.931766:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548755.932764:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548755.933038:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416155008 00000100:00100000:3.0:1787548755.933047:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416155008 00010000:00010000:3.0:1787548755.933101:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f147 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23da expref: 6 pid: 5856 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548755.933162:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 61 00000100:00100000:3.0:1787548755.933173:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92088e20-066b-499e-ac52-ab10992c506a+6:2351:x1874380416155008:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548755.933186:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548755.933192:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f147 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23da expref: 6 pid: 5856 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.933218:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f147 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23da expref: 6 pid: 5856 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.933237:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f147 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23da expref: 6 pid: 5856 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.933250:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:3.0:1787548755.933255:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.933263:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.933271:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.933292:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548755.933335:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92088e20-066b-499e-ac52-ab10992c506a+5:2351:x1874380416155008:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 165us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548755.933342:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 61 00010000:00010000:3.0:1787548755.933368:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.933376:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.933394:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f18d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.933413:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f18d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.933420:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f18d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548755.934574:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787548755.934600:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.934608:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.934616:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.934622:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fe00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548755.934626:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.934634:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.934648:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec90d93700) 00010000:00010000:3.0:1787548755.934651:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548755.934655:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.934661:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f186 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787548755.934691:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003da62ae4 reply state 00000000b10f162c transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f18d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548755.934700:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787548755.934766:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:11337:x1874380416154880:12345-192.168.206.13@tcp:36:lfs.0 Request processed in 11227us (11351us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787548755.934775:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 140 00000100:00080000:2.0:1787548755.937048:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787548755.943161:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f18d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.943178:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f18d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.943185:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f18d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.943191:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548755.943196:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f18d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.943204:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f18d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.943220:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8fec90d93600) 00010000:00010000:3.0:1787548755.943223:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548755.943227:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f18d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548755.943233:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f18d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548756.014913:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548756.014969:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416155136 00000100:00100000:1.0:1787548756.014981:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416155136 00000100:00100000:1.0:1787548756.015051:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 141 00000100:00100000:1.0:1787548756.015063:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:11345:x1874380416155136:12345-192.168.206.13@tcp:101:lctl.0 00010000:00010000:1.0:1787548756.015095:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548756.015125:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f194 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a23ef expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548756.015254:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f19b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548756.015272:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f19b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548756.015288:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f19b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548756.015856:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787548756.015863:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787548756.016022:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f19b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548756.016066:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f194 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23ef expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548756.016088:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f19b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23ef expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548756.016097:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2d51600) 00010000:00010000:1.0:1787548756.016101:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787548756.016106:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22e400, rc 0) 00000100:00100000:1.0:1787548756.020415:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+15:11345:x1874380416155136:12345-192.168.206.13@tcp:101:lctl.0 Request processed in 5332us (5493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548756.020434:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 141 00000001:00080000:1.0:1787548756.042658:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000001:00080000:1.0:1787548756.042679:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000100:00100000:2.0:1787548756.091743:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548756.094700:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416155264 00000100:00100000:1.0:1787548756.094722:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416155264 00000100:00100000:2.0:1787548756.095459:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 142 00000100:00100000:2.0:1787548756.095473:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:11351:x1874380416155264:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:2.0:1787548756.095613:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548756.095712:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424f1a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a23f6 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.095793:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424f1a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.095810:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424f1a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.095847:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424f1a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.095865:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f1b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.095872:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.095879:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.096781:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424f1b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.096794:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424f1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.096803:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424f1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548756.096976:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787548756.096981:0:8467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548756.097169:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424f1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097186:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424f1a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097194:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424f1a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097212:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424f1a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097219:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ed200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548756.097224:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424f1a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097232:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424f1a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097248:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2d51600) 00010000:00010000:2.0:1787548756.097250:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548756.097256:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424f1a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097261:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424f1a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097276:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097282:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f1b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097287:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097292:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548756.097295:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097312:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097321:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8fec87ceb400) 00010000:00010000:2.0:1787548756.097323:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548756.097326:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f1b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097332:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec400/0xcb7c48919424f1b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097375:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424f1a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23f6 expref: 15 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097390:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424f1b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23f6 expref: 14 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.097397:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:2.0:1787548756.097399:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787548756.097402:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ede00, rc 0) 00000100:00100000:2.0:1787548756.097863:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:11351:x1874380416155264:12345-192.168.206.13@tcp:101:bash.0 Request processed in 2390us (6129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548756.097873:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 142 00000100:00100000:2.0:1787548756.104100:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548756.104285:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416155520 00000100:00100000:0.0:1787548756.104299:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416155520 00000100:00100000:0.0:1787548756.104369:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 143 00000100:00100000:0.0:1787548756.104381:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+14:11351:x1874380416155520:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:0.0:1787548756.104408:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548756.104434:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f1be lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a23fd expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.104923:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f1c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.104942:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f1c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.104955:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f1c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.109438:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f1cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.109465:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f1cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.109555:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f1cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787548756.113154:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787548756.113451:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f1d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.113489:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.113504:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.113556:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f1c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.113564:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f1c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.113572:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f1c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.113589:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548756.113594:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f1c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.113603:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f1c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.113619:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:0.0:1787548756.113623:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548756.113628:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f1c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.113635:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f1c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787548756.113651:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020ca0e81 reply state 00000000d4868d4f transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f1cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548756.113668:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787548756.113730:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f1be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23fd expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.113748:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23fd expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.113756:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548756.113759:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548756.113761:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151400, rc 0) 00000100:00100000:0.0:1787548756.113857:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:11351:x1874380416155520:12345-192.168.206.13@tcp:101:bash.0 Request processed in 9478us (9771us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787548756.113867:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 143 00010000:00010000:2.0:1787548756.121570:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f1cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.121606:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f1cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.121637:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f1cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.121644:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548756.121650:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f1cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.121658:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f1cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.121681:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8feca2cf6800) 00010000:00010000:2.0:1787548756.121685:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548756.121691:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f1cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.121698:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f1cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548756.122249:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.122440:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416155648 00000100:00100000:3.0:1787548756.122456:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416155648 00000100:00100000:3.0:1787548756.122540:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 47 00000100:00100000:3.0:1787548756.122551:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2354:x1874380416155648:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:3.0:1787548756.122569:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548756.122600:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f1e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2404 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787548756.122628:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787548756.122645:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1787548756.122650:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548756.122659:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f1e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2404 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.122678:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f1e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2404 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.122690:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93e00, rc 0) 00000100:00100000:3.0:1787548756.122753:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2354:x1874380416155648:12345-192.168.206.13@tcp:101:bash.0 Request processed in 204us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548756.122759:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 47 00000100:00080000:2.0:1787548756.122834:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548756.125377:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548756.125933:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416155776 00000100:00100000:2.0:1787548756.125947:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416155776 00000100:00100000:2.0:1787548756.126016:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 48 00000100:00100000:2.0:1787548756.126026:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:11351:x1874380416155776:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:2.0:1787548756.126043:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548756.126060:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a240b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.126089:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f1e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2404 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.126111:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787548756.126117:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548756.126123:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.126205:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f1e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2404 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.126219:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f1e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2404 expref: 7 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548756.126234:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5126a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1874380431889024:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548756.126326:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec901086c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548756.129781:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.129969:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416155904 00000100:00100000:3.0:1787548756.129983:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416155904 00010000:00010000:3.0:1787548756.130037:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f1e1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2404 expref: 8 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548756.130185:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 62 00000100:00100000:3.0:1787548756.130200:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2351:x1874380416155904:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548756.130220:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548756.130252:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f1e1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2404 expref: 8 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.130272:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f1e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2404 expref: 8 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548756.130272:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5126a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1874380431889024:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548756.130337:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f1e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2404 expref: 8 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.130869:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548756.130875:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548756.130887:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.130900:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.130921:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.130943:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ec400, rc 0) 00010000:00010000:3.0:1787548756.130954:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548756.130973:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5839:1874380431889152:192.168.206.13@tcp:105: 00000100:00100000:2.0:1787548756.131020:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:11351:x1874380416155776:12345-192.168.206.13@tcp:101:bash.0 Request processed in 4992us (5651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548756.131029:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 48 00000100:00100000:3.0:1787548756.133309:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787548756.140311:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5839:1874380431889152:192.168.206.13@tcp:105: 00010000:00010000:3.0:1787548756.140349:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548756.140423:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416155904:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 10226us (10663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548756.140435:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 62 00000100:00100000:2.0:1787548756.143299:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.143629:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416156160 00000100:00100000:3.0:1787548756.143642:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416156160 00000100:00100000:3.0:1787548756.143836:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 36 00000100:00100000:3.0:1787548756.143848:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+16:11351:x1874380416156160:12345-192.168.206.13@tcp:35:bash.0 00000100:00100000:3.0:1787548756.144560:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:11351:x1874380416156160:12345-192.168.206.13@tcp:35:bash.0 Request processed in 711us (1270us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787548756.144570:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 36 00000100:00100000:0.0:1787548756.257436:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.258960:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416156416 00000100:00100000:3.0:1787548756.258972:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416156416 00000100:00100000:3.0:1787548756.259045:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 144 00000100:00100000:3.0:1787548756.259055:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:11361:x1874380416156416:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548756.259081:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548756.259100:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f1ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2412 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548756.259222:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787548756.259325:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f1ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2412 expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.259339:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2d51600) 00010000:00010000:3.0:1787548756.259355:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787548756.259361:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f1ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2412 expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.259374:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93e00, rc 0) 00000100:00100000:3.0:1787548756.259449:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:11361:x1874380416156416:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 394us (2194us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1787548756.259456:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 144 00000100:00100000:1.0:1787548756.269118:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548756.269305:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416156672 00000100:00100000:2.0:1787548756.269327:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416156672 00000100:00100000:2.0:1787548756.269377:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 37 00000100:00100000:2.0:1787548756.269386:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:11361:x1874380416156672:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:2.0:1787548756.269649:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:11361:x1874380416156672:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 264us (539us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787548756.269657:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 37 00000100:00100000:1.0:1787548756.352947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548756.353030:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416156800 00000100:00100000:2.0:1787548756.353040:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416156800 00000100:00100000:2.0:1787548756.353097:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 145 00000100:00100000:2.0:1787548756.353106:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:11367:x1874380416156800:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548756.353163:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548756.353183:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424f1fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2419 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.353246:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424f204 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.353259:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424f204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.353272:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424f204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548756.353328:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787548756.353332:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548756.353352:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424f204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.353377:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424f1fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2419 expref: 21 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.353414:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424f204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2419 expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.353423:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:2.0:1787548756.353426:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787548756.353429:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21ec200, rc 0) 00000100:00100000:2.0:1787548756.353474:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:11367:x1874380416156800:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 369us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548756.353481:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 145 00000100:00100000:0.0:1787548756.360085:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.360197:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416157056 00000100:00100000:3.0:1787548756.360206:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416157056 00000100:00100000:3.0:1787548756.360257:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 146 00000100:00100000:3.0:1787548756.360266:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:11367:x1874380416157056:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548756.360284:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548756.360301:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f20b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2420 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.360392:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f212 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.360404:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.360416:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548756.360426:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787548756.360557:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f20b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2420 expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.360603:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2420 expref: 22 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.360612:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:3.0:1787548756.360615:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787548756.360618:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92800, rc 0) 00000100:00100000:3.0:1787548756.360671:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+22:11367:x1874380416157056:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 406us (594us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787548756.360678:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 146 00000100:00100000:1.0:1787548756.367219:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548756.367300:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416157312 00000100:00100000:2.0:1787548756.367310:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416157312 00000100:00100000:2.0:1787548756.367367:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 147 00000100:00100000:2.0:1787548756.367377:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+22:11367:x1874380416157312:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548756.367399:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548756.367416:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424f220 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2427 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.367511:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f227 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.367531:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.367543:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548756.367554:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787548756.367683:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ed200/0xcb7c48919424f220 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2427 expref: 25 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.367701:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f227 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2427 expref: 24 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.367709:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:2.0:1787548756.367712:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787548756.367715:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6200, rc 0) 00000100:00100000:2.0:1787548756.367784:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+24:11367:x1874380416157312:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 408us (572us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787548756.367790:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 147 00000100:00100000:1.0:1787548756.371906:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.372014:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416157440 00000100:00100000:3.0:1787548756.372023:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416157440 00000100:00100000:3.0:1787548756.372118:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:3.0:1787548756.372162:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+24:2354:x1874380416157440:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548756.372177:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548756.372198:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f212 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2420 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.372215:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:3.0:1787548756.372219:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548756.372259:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+23:2354:x1874380416157440:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 133us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548756.372266:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:1.0:1787548756.375541:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.375680:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416157568 00000100:00100000:3.0:1787548756.375690:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416157568 00000100:00100000:3.0:1787548756.375904:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 49 00000100:00100000:3.0:1787548756.375928:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416157568:12345-192.168.206.13@tcp:1:lfs.0 00010000:00010000:3.0:1787548756.375968:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f235 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.375989:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.375998:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548756.376003:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787548756.376008:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f235 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.376041:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.376055:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 6 pid: 6692 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548756.376069:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1874380431889280:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548756.376215:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787548756.378828:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.379019:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1874380431889280:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548756.379044:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f235 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548756.379090:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416157696 00000100:00100000:2.0:1787548756.379096:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416157696 00002000:00100000:2.0:1787548756.379253:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8fecbcdfbb80 x1874380416157696/t0(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:197/0 lens 504/0 e 0 to 0 dl 1787548767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787548756.379264:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fecbcdfbb80 with x1874380416157696 ext(0->12) 00010000:00010000:2.0:1787548756.379271:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 7 pid: 6692 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.379286:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 7 pid: 6692 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787548756.379294:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fecbcdfbb80 00000100:00100000:2.0:1787548756.379351:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 2 00000100:00100000:2.0:1787548756.379370:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2351:x1874380416157696:12345-192.168.206.13@tcp:4:lfs.0 00000100:00100000:2.0:1787548756.379923:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2351:x1874380416157696:12345-192.168.206.13@tcp:4:lfs.0 Request processed in 562us (1101us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787548756.379936:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 2 00002000:00100000:2.0:1787548756.379944:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8fecbcdfbb80 x1874380416157696/t4294967305(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:197/0 lens 504/448 e 0 to 0 dl 1787548767 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787548756.379951:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fecbcdfbb80 with x1874380416157696 ext(0->12) 00010000:00010000:2.0:1787548756.379957:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 9 pid: 6692 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.379969:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 9 pid: 6692 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787548756.379975:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fecbcdfbb80 00000100:00100000:1.0:1787548756.383224:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548756.383636:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416157824 00000100:00100000:0.0:1787548756.383645:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416157824 00010000:00010000:0.0:1787548756.383681:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 9 pid: 6692 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548756.383861:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 63 00000100:00100000:0.0:1787548756.383874:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2352:x1874380416157824:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548756.383890:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787548756.383909:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787548756.383912:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787548756 00002000:00010000:0.0:1787548756.383914:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787548757 00002000:00010000:0.0:1787548756.383928:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787548756 00010000:00010000:0.0:1787548756.383934:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 9 pid: 6692 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.383948:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 9 pid: 6692 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.383971:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f1e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a240b expref: 9 pid: 6692 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.383988:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787548756.383992:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787548756.383997:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f235 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.384007:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f235 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.384040:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548756.384097:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2352:x1874380416157824:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 226us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548756.384104:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 63 00010000:00010000:2.0:1787548756.384167:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f235 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.384177:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f235 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.384202:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f235 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.384210:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f235 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.384217:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f235 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.384235:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93e00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548756.384239:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f235 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.384248:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f235 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.384259:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f235 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.384266:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f235 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548756.384310:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2352:x1874380416157568:12345-192.168.206.13@tcp:1:lfs.0 Request processed in 8385us (8778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548756.384318:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 49 00000100:00100000:1.0:1787548756.387495:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.387642:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416158080 00000100:00100000:3.0:1787548756.387652:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416158080 00000100:00100000:3.0:1787548756.387719:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 38 00000100:00100000:3.0:1787548756.387739:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca6f15c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+23:11367:x1874380416158080:12345-192.168.206.13@tcp:35:lfs.0 00000004:00010000:3.0:1787548756.387798:0:5858:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f227 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2427 expref: 23 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787548756.388023:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787548756.388069:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1787548756.388623:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1787548756.388678:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.388693:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f1d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23fd expref: 27 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.388702:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.388734:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23fd expref: 27 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.388754:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f1d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23fd expref: 27 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548756.388768:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5858:1874380431889408:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548756.388852:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787548756.393228:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548756.393315:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416158208 00000100:00100000:0.0:1787548756.393325:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416158208 00000100:00100000:3.0:1787548756.393344:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5858:1874380431889408:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548756.393362:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f1d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23fd expref: 28 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.393378:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548756.393415:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 64 00000100:00100000:0.0:1787548756.393447:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+28:2351:x1874380416158208:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548756.393463:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548756.393470:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f1d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23fd expref: 28 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.393483:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23fd expref: 28 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.393504:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f1d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23fd expref: 28 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.393519:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548756.393525:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.393534:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.393542:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.393572:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548756.393638:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+27:2351:x1874380416158208:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 205us (417us total) trans 0 rc 0/0 00010000:00010000:3.0:1787548756.393642:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548756.393649:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 64 00010000:00010000:3.0:1787548756.393656:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787548756.393786:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787548756.393972:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1787548756.394072:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431889536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787548756.394127:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548756.394184:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787548756.394290:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431889536 00000100:00100000:0.0:1787548756.394295:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431889536 00000100:00100000:0.0:1787548756.394561:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787548756.394570:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1874380431889536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787548756.394720:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1874380431889536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 91us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548756.394730:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787548756.395101:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431889536:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787548756.396106:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787548756.396207:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbcb3c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431889664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787548756.396260:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548756.396830:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec883813c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548756.396891:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431889664 00000100:00100000:2.0:1787548756.396898:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431889664 00000100:00100000:2.0:1787548756.396996:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787548756.397007:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1874380431889664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787548756.397223:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5858:x1874380431889664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 218us (962us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787548756.397231:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787548756.397303:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbcb3c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431889664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787548756.397373:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1787548756.397425:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.397448:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.397457:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.397463:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548756.397468:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.397475:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.397490:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548756.397493:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787548756.397498:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.397519:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f23c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787548756.397735:0:5858:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787548756.397828:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1787548756.397838:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379274707257ns, next at 380274705590ns, rc = 0 00000001:00080000:0.0:1787548756.397844:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787548756.397873:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548756.397876:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787548756.397883:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f227 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2427 expref: 31 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548756.397983:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca6f15c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+30:11367:x1874380416158080:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 10255us (10506us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787548756.397991:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 38 00000020:00080000:0.0:1787548756.397996:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787548756.400438:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.400876:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416158336 00000100:00100000:3.0:1787548756.400886:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416158336 00000100:00100000:3.0:1787548756.400939:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 148 00000100:00100000:3.0:1787548756.400948:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+30:11367:x1874380416158336:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548756.400971:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548756.400991:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f243 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a242e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.401043:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f243 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a242e expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.401056:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f243 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a242e expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.401075:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:3.0:1787548756.401088:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787548756.401092:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92800, rc 0) 00000100:00100000:3.0:1787548756.401206:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+31:11367:x1874380416158336:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 259us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548756.401214:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 148 00000100:00100000:1.0:1787548756.406273:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.406642:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416158592 00000100:00100000:3.0:1787548756.406652:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416158592 00000100:00100000:3.0:1787548756.406709:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 39 00000100:00100000:3.0:1787548756.406719:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+31:11367:x1874380416158592:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:3.0:1787548756.407082:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+32:11367:x1874380416158592:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 363us (817us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787548756.407090:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 39 00010000:00010000:2.0:1787548756.421232:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548756.506722:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548756.506997:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416158848 00000100:00100000:1.0:1787548756.507007:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416158848 00000100:00100000:1.0:1787548756.507122:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 149 00000100:00100000:1.0:1787548756.507165:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+32:11377:x1874380416158848:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:1.0:1787548756.507192:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548756.507225:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f24a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2435 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548756.507349:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787548756.507467:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f24a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2435 expref: 34 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548756.507482:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2d51600) 00010000:00010000:1.0:1787548756.507485:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787548756.507490:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f24a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2435 expref: 34 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548756.507503:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22fe00, rc 0) 00000100:00100000:1.0:1787548756.507567:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+33:11377:x1874380416158848:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 435us (854us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1787548756.507574:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 149 00000100:00100000:1.0:1787548756.513203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548756.513314:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416158976 00000100:00100000:2.0:1787548756.513323:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416158976 00000100:00100000:2.0:1787548756.513379:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 150 00000100:00100000:2.0:1787548756.513388:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+33:11377:x1874380416158976:12345-192.168.206.13@tcp:34:lfs.0 00010000:00010000:2.0:1787548756.513459:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f258 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.513475:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f258 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.513498:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f258 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.513513:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f25f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.513520:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.513527:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.513629:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f266 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.513637:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.513644:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787548756.513681:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.513706:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f258 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.513713:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f258 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.513720:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f258 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.513726:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548756.513735:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f258 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.513743:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f258 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.513755:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:2.0:1787548756.513758:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548756.513762:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f258 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514336:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f258 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514351:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514357:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f25f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514362:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f25f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514374:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548756.514377:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f25f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514382:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f25f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514391:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fec87ceb400) 00010000:00010000:2.0:1787548756.514394:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548756.514397:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f25f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514403:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f25f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514417:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514423:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f266 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514428:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514432:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548756.514435:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514441:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f266 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514459:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:2.0:1787548756.514461:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548756.514464:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f266 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548756.514470:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f266 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548756.514551:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+33:11377:x1874380416158976:12345-192.168.206.13@tcp:34:lfs.0 Request processed in 1162us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548756.514561:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 150 00000100:00100000:2.0:1787548756.520274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548756.520476:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416159232 00000100:00100000:0.0:1787548756.520488:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416159232 00000100:00100000:0.0:1787548756.520547:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 40 00000100:00100000:0.0:1787548756.520557:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+33:11377:x1874380416159232:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:0.0:1787548756.520808:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+34:11377:x1874380416159232:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 253us (543us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787548756.520816:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 40 00000100:00100000:1.0:1787548756.569292:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548756.569596:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416159488 00000100:00100000:0.0:1787548756.569605:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416159488 00000100:00100000:0.0:1787548756.569666:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 151 00000100:00100000:0.0:1787548756.569678:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+34:11380:x1874380416159488:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548756.569714:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548756.569733:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f26d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a243c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.569806:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f274 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.569819:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.569911:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.569930:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f27b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.569937:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f27b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.569945:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f27b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570064:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f282 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570072:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570080:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548756.570089:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787548756.570225:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570233:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f274 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570239:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f274 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570245:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548756.570250:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f274 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570257:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f274 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570270:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:0.0:1787548756.570273:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548756.570278:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f274 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570283:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f274 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570295:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f27b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570301:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f27b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570307:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f27b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570323:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548756.570327:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f27b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570333:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f27b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570341:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548756.570343:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548756.570345:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f27b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570351:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f27b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570392:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f26d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a243c expref: 37 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570407:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a243c expref: 36 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.570414:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:0.0:1787548756.570416:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548756.570419:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150600, rc 0) 00000100:00100000:0.0:1787548756.570484:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+36:11380:x1874380416159488:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 809us (1201us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787548756.570493:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 151 00000100:00100000:1.0:1787548756.574117:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.575981:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416159616 00000100:00100000:3.0:1787548756.575994:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416159616 00000100:00100000:3.0:1787548756.576196:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 152 00000100:00100000:3.0:1787548756.576208:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+36:11380:x1874380416159616:12345-192.168.206.13@tcp:54:lfs.0 00010000:00010000:3.0:1787548756.576277:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f290 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.576293:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.576305:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.576332:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.576339:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f290 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.576361:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.576367:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548756.576372:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.576379:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f290 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.576391:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:3.0:1787548756.576394:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787548756.576398:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f290 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.576422:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f290 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548756.576507:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+36:11380:x1874380416159616:12345-192.168.206.13@tcp:54:lfs.0 Request processed in 300us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548756.576515:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 152 00000100:00100000:2.0:1787548756.585995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.586153:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416159872 00000100:00100000:3.0:1787548756.586163:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416159872 00000100:00100000:3.0:1787548756.586208:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 41 00000100:00100000:3.0:1787548756.586217:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+36:11380:x1874380416159872:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:3.0:1787548756.586453:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+37:11380:x1874380416159872:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 236us (466us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787548756.586461:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 41 00000100:00100000:1.0:1787548756.917661:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548756.917745:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416160128 00000100:00100000:0.0:1787548756.917764:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416160128 00000100:00100000:0.0:1787548756.917820:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 153 00000100:00100000:0.0:1787548756.917830:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+37:11411:x1874380416160128:12345-192.168.206.13@tcp:101:cat.0 00010000:00010000:0.0:1787548756.917854:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548756.917872:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f297 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2443 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.917978:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f29e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.917991:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f29e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.918002:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f29e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548756.918012:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787548756.918267:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f297 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2443 expref: 40 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.918284:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f29e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2443 expref: 39 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548756.918293:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:0.0:1787548756.918295:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548756.918299:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150400, rc 0) 00000100:00100000:0.0:1787548756.918586:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:11411:x1874380416160128:12345-192.168.206.13@tcp:101:cat.0 Request processed in 746us (923us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787548756.918593:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 153 00000100:00100000:1.0:1787548756.928454:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.928543:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416160384 00000100:00100000:3.0:1787548756.928553:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416160384 00000100:00100000:3.0:1787548756.928621:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 42 00000100:00100000:3.0:1787548756.928632:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:11411:x1874380416160384:12345-192.168.206.13@tcp:35:cat.0 00000100:00100000:3.0:1787548756.928908:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+40:11411:x1874380416160384:12345-192.168.206.13@tcp:35:cat.0 Request processed in 278us (461us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787548756.928917:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 42 00000100:00100000:2.0:1787548756.930518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548756.930596:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416160512 00000100:00100000:3.0:1787548756.930603:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416160512 00000100:00100000:3.0:1787548756.930657:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:3.0:1787548756.930667:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+40:2351:x1874380416160512:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548756.930681:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548756.930704:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f29e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2443 expref: 40 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548756.930739:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:3.0:1787548756.930744:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548756.930790:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:2351:x1874380416160512:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 124us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548756.930798:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:1.0:1787548757.006743:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548757.006835:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416160768 00000100:00100000:2.0:1787548757.006845:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416160768 00000100:00100000:2.0:1787548757.006923:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 154 00000100:00100000:2.0:1787548757.006933:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:11417:x1874380416160768:12345-192.168.206.13@tcp:101:dd.0 00010000:00010000:2.0:1787548757.006958:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548757.006961:0:8467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787548757.006985:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ec200/0xcb7c48919424f204 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2419 expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.007004:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:2.0:1787548757.007009:0:8467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787548757.007021:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a244a expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787548757.007174:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787548757.008386:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.008405:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f282 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a243c expref: 39 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.008415:0:8467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.008448:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a243c expref: 39 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.008462:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f282 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a243c expref: 39 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548757.008488:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5126a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431889792:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548757.008585:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec90108000 going to sleep for 11 seconds 00000100:00100000:1.0:1787548757.011241:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548757.011402:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5126a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431889792:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548757.011427:0:8467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548757.011496:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416160896 00000100:00100000:0.0:1787548757.011503:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416160896 00010000:00010000:0.0:1787548757.011533:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f282 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a243c expref: 40 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548757.011568:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 65 00000100:00100000:0.0:1787548757.011586:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad563480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+40:2351:x1874380416160896:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548757.011600:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548757.011607:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f282 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a243c expref: 40 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.011620:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a243c expref: 40 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.011639:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f282 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a243c expref: 40 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.011652:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:0.0:1787548757.011657:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.011665:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.011673:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.011703:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548757.011768:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad563480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:2351:x1874380416160896:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 191us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548757.011788:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 65 00010000:00010000:2.0:1787548757.012059:0:8467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.012067:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548757.012085:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787548757.012261:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a244a expref: 40 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.012277:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a244a expref: 39 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.012284:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:2.0:1787548757.012287:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787548757.012289:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6200, rc 0) 00000100:00100000:2.0:1787548757.012328:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:11417:x1874380416160768:12345-192.168.206.13@tcp:101:dd.0 Request processed in 5397us (5594us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787548757.012334:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 154 00000100:00100000:1.0:1787548757.024309:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548757.024399:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416161152 00000100:00100000:2.0:1787548757.024408:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416161152 00000100:00100000:2.0:1787548757.024464:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 155 00000100:00100000:2.0:1787548757.024474:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:11417:x1874380416161152:12345-192.168.206.13@tcp:36:dd.0 00010000:00010000:2.0:1787548757.024970:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.024987:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.024998:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787548757.025292:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787548757.025323:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f5259d1 reply state 000000004aee13c5 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548757.025332:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787548757.025433:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+42:11417:x1874380416161152:12345-192.168.206.13@tcp:36:dd.0 Request processed in 959us (1299us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787548757.025441:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 155 00000020:00080000:2.0:1787548757.025446:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787548757.034570:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.034600:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.034608:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.034628:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548757.034632:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.034640:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.034656:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:3.0:1787548757.034659:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548757.034662:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.034668:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548757.309157:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548757.309284:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416161280 00000100:00100000:3.0:1787548757.309295:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416161280 00000100:00100000:3.0:1787548757.309363:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 156 00000100:00100000:3.0:1787548757.309374:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+41:11432:x1874380416161280:12345-192.168.206.13@tcp:101:stat.0 00010000:00010000:3.0:1787548757.309397:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548757.309417:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f2c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2451 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.309476:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f2cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.309489:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f2cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.309503:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f2cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.309530:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f2d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.309537:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.309544:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.309655:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f2dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.309666:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a244a expref: 42 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.309674:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f2dd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.309707:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a244a expref: 42 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.309719:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a244a expref: 42 pid: 8467 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548757.309733:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad63e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431889920:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548757.310212:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787548757.314399:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548757.314545:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad63e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431889920:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548757.314569:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f2dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548757.314666:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416161536 00000100:00100000:1.0:1787548757.314673:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416161536 00000100:00100000:1.0:1787548757.314722:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 43 00000100:00100000:1.0:1787548757.314732:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+43:5593:x1874380416161536:12345-192.168.206.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787548757.315033:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+44:5593:x1874380416161536:12345-192.168.206.13@tcp:35:ldlm_bl.0 Request processed in 302us (642us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787548757.315040:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 43 00000040:00080000:3.0:1787548757.315287:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787548757.315292:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787548757.315469:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787548757.315476:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787548757.318715:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548757.318808:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416161664 00000100:00100000:3.0:1787548757.318817:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416161664 00010000:00010000:3.0:1787548757.318856:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a244a expref: 44 pid: 8467 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548757.318896:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 66 00000100:00100000:3.0:1787548757.318906:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad562a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+44:2351:x1874380416161664:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548757.318920:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548757.318927:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a244a expref: 44 pid: 8467 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.318941:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a244a expref: 44 pid: 8467 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.318963:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f2b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a244a expref: 44 pid: 8467 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.318980:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:3.0:1787548757.318985:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f2dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.318994:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f2dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.319019:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f2dd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.319049:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548757.319103:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad562a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+43:2351:x1874380416161664:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 198us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548757.319110:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 66 00010000:00010000:1.0:1787548757.319662:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f2dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319672:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f2dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548757.319719:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787548757.319724:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787548757.319746:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f2dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319760:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f2dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319770:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f2cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319776:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f2cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319806:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f2cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319811:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548757.319816:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f2cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319823:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f2cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319836:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:1.0:1787548757.319839:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548757.319842:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f2cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319849:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f2cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319863:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319869:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f2d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319875:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319880:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548757.319883:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319900:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f2d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319909:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fec90d93400) 00010000:00010000:1.0:1787548757.319911:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548757.319914:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f2d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319920:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f2d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319956:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f2c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2451 expref: 43 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319971:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f2dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2451 expref: 42 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.319978:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:1.0:1787548757.319981:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787548757.319983:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92a00, rc 0) 00000100:00100000:1.0:1787548757.320032:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+42:11432:x1874380416161280:12345-192.168.206.13@tcp:101:stat.0 Request processed in 10661us (10908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548757.320041:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 156 00000100:00100000:1.0:1787548757.376824:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548757.377171:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416161920 00000100:00100000:0.0:1787548757.377180:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416161920 00000100:00100000:0.0:1787548757.377289:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 157 00000100:00100000:0.0:1787548757.377300:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+42:11438:x1874380416161920:12345-192.168.206.13@tcp:36:truncate.0 00010000:00010000:0.0:1787548757.377354:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548757.377380:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f2dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2451 expref: 42 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.377398:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:0.0:1787548757.377403:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787548757.377604:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f2e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.377617:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f2e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.377627:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f2e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787548757.377677:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787548757.377702:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092270959 reply state 000000009b990b4e transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f2e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548757.377711:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787548757.377820:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+44:11438:x1874380416161920:12345-192.168.206.13@tcp:36:truncate.0 Request processed in 521us (1004us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787548757.377827:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 157 00000020:00080000:0.0:1787548757.377846:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787548757.379551:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f2e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.379566:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f2e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.379581:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f2e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.379588:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548757.379592:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f2e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.379599:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f2e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.379612:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:3.0:1787548757.379616:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548757.379620:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f2e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.379626:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f2e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.443662:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548757.508757:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548757.509077:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416162048 00000100:00100000:2.0:1787548757.509088:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416162048 00000100:00100000:2.0:1787548757.509178:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 158 00000100:00100000:2.0:1787548757.509189:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+43:11452:x1874380416162048:12345-192.168.206.13@tcp:101:stat.0 00010000:00010000:2.0:1787548757.509212:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548757.509230:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2458 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509293:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f2f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509307:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f2f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509318:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f2f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509331:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f2f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509338:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509344:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509432:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509618:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509626:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548757.509662:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787548757.509666:0:8467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548757.509684:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509695:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509703:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f2f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509709:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f2f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509714:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f2f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509719:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548757.509723:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f2f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509783:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f2f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509796:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:2.0:1787548757.509804:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548757.509808:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f2f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509814:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f2f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509825:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509831:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f2f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509837:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509841:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548757.509844:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509850:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f2f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509857:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fec87ceb400) 00010000:00010000:2.0:1787548757.509860:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548757.509863:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f2f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509869:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f2f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509901:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f2eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2458 expref: 45 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509928:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2458 expref: 44 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.509934:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:2.0:1787548757.509936:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548757.509939:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6200, rc 0) 00000100:00100000:2.0:1787548757.510058:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+44:11452:x1874380416162048:12345-192.168.206.13@tcp:101:stat.0 Request processed in 871us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548757.510066:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 158 00000100:00100000:2.0:1787548757.619593:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548757.619863:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416162304 00000100:00100000:1.0:1787548757.619872:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416162304 00000100:00100000:1.0:1787548757.619939:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 159 00000100:00100000:1.0:1787548757.619950:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+44:11462:x1874380416162304:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:1.0:1787548757.619968:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548757.619987:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f307 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a245f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548757.620097:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787548757.620258:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f307 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a245f expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.620272:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2d51600) 00010000:00010000:1.0:1787548757.620275:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787548757.620280:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f307 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a245f expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.620292:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22fe00, rc 0) 00000100:00100000:1.0:1787548757.620356:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+45:11462:x1874380416162304:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 407us (780us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1787548757.620363:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 159 00000100:00100000:3.0:1787548757.623849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548757.623923:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416162560 00000100:00100000:1.0:1787548757.623933:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416162560 00000100:00100000:1.0:1787548757.623987:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 44 00000100:00100000:1.0:1787548757.623998:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca6f15450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+45:11462:x1874380416162560:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:1.0:1787548757.624282:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca6f15450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+46:11462:x1874380416162560:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 285us (440us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787548757.624291:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 44 00000100:00100000:3.0:1787548757.694051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548757.694162:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416162816 00000100:00100000:1.0:1787548757.694184:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416162816 00000100:00100000:1.0:1787548757.694246:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 160 00000100:00100000:1.0:1787548757.694256:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+46:11468:x1874380416162816:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:1.0:1787548757.694282:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548757.694301:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f315 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2466 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.694408:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.694423:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f300 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2458 expref: 47 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.694431:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.694460:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2458 expref: 47 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.694487:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f300 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2458 expref: 47 pid: 8467 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548757.694502:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431890048:192.168.206.13@tcp:104: 00000100:00100000:1.0:1787548757.694602:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548757.705661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548757.705774:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431890048:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548757.705798:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548757.707300:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416162944 00000100:00100000:0.0:1787548757.707311:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416162944 00010000:00010000:0.0:1787548757.707350:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f300 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2458 expref: 48 pid: 8467 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548757.707392:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 67 00000100:00100000:0.0:1787548757.707402:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+48:2351:x1874380416162944:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548757.707415:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548757.707423:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f300 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2458 expref: 48 pid: 8467 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.707435:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2458 expref: 48 pid: 8467 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.707456:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f300 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2458 expref: 48 pid: 8467 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.707482:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:0.0:1787548757.707487:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.707496:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.707502:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.707533:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548757.707604:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+47:2351:x1874380416162944:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 203us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548757.707625:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 67 00010000:00010000:3.0:1787548757.707711:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.707719:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548757.707751:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787548757.707889:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f315 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2466 expref: 48 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.707904:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2466 expref: 47 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.707912:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:3.0:1787548757.707915:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787548757.707917:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22f600, rc 0) 00000100:00100000:3.0:1787548757.707943:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+47:11468:x1874380416162816:12345-192.168.206.13@tcp:101:bash.0 Request processed in 13689us (13904us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1787548757.707950:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 160 00000100:00100000:3.0:1787548757.710951:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548757.711034:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416163200 00000100:00100000:1.0:1787548757.711043:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416163200 00000100:00100000:1.0:1787548757.711096:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 161 00000100:00100000:1.0:1787548757.711106:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+47:11468:x1874380416163200:12345-192.168.206.13@tcp:36:bash.0 00010000:00010000:1.0:1787548757.711404:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f32a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.711419:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f32a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.711430:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f32a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787548757.711493:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1787548757.711517:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015d707b3 reply state 00000000a8a508ff transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f32a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548757.711526:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787548757.711619:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+50:11468:x1874380416163200:12345-192.168.206.13@tcp:36:bash.0 Request processed in 513us (676us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787548757.711626:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 161 00000020:00080000:1.0:1787548757.711631:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787548757.713647:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f32a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.713675:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f32a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.713682:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f32a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.713702:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22ec00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548757.713707:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f32a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.713714:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f32a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.713738:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:3.0:1787548757.713741:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548757.713746:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f32a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.713752:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f32a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548757.725786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548757.726152:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416163328 00000100:00100000:2.0:1787548757.726162:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416163328 00000100:00100000:2.0:1787548757.726228:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 162 00000100:00100000:2.0:1787548757.726238:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+49:11468:x1874380416163328:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:2.0:1787548757.726263:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548757.726281:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f331 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a246d expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.726607:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f338 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.726623:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2466 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.726631:0:8467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f338 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.726680:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2466 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.726693:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2466 expref: 50 pid: 5854 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548757.726706:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5125500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431890176:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548757.726790:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec90108000 going to sleep for 11 seconds 00000100:00100000:0.0:1787548757.730935:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5125500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431890176:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548757.730965:0:8467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f338 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548757.731610:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548757.735448:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416163456 00000100:00100000:2.0:1787548757.735465:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416163456 00010000:00010000:2.0:1787548757.735516:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2466 expref: 51 pid: 5854 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548757.735639:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 68 00000100:00100000:2.0:1787548757.735649:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:2351:x1874380416163456:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548757.735665:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548757.735672:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2466 expref: 51 pid: 5854 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.735685:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2466 expref: 51 pid: 5854 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.735705:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f31c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2466 expref: 51 pid: 5854 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.735732:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:2.0:1787548757.735749:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f338 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.735758:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.735764:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f338 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.735801:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548757.735864:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+50:2351:x1874380416163456:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 217us (4256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548757.735872:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 68 00010000:00010000:3.0:1787548757.736216:0:8467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.736225:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548757.736274:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787548757.736278:0:8467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548757.736318:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.736347:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f331 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a246d expref: 50 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.736362:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a246d expref: 49 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548757.736369:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:3.0:1787548757.736371:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787548757.736373:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6000, rc 0) 00000100:00100000:3.0:1787548757.736398:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+49:11468:x1874380416163328:12345-192.168.206.13@tcp:101:bash.0 Request processed in 10163us (10621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548757.736404:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 162 00000100:00100000:3.0:1787548757.744915:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548757.748524:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416163712 00000100:00100000:1.0:1787548757.748540:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416163712 00000100:00100000:1.0:1787548757.748612:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 45 00000100:00100000:1.0:1787548757.748623:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+49:11468:x1874380416163712:12345-192.168.206.13@tcp:35:bash.0 00000100:00100000:1.0:1787548757.749020:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+50:11468:x1874380416163712:12345-192.168.206.13@tcp:35:bash.0 Request processed in 398us (4127us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787548757.749028:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 45 00000100:00100000:1.0:1787548757.874643:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548757.874819:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416163968 00000100:00100000:2.0:1787548757.874829:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416163968 00000100:00100000:2.0:1787548757.875003:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 163 00000100:00100000:2.0:1787548757.875015:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+50:11478:x1874380416163968:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548757.875040:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548757.875061:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f33f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2474 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548757.875243:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787548757.875366:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f33f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2474 expref: 52 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.875381:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2d51600) 00010000:00010000:2.0:1787548757.875384:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787548757.875389:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f33f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2474 expref: 52 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548757.875423:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7200, rc 0) 00000100:00100000:2.0:1787548757.875613:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:11478:x1874380416163968:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 599us (980us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787548757.875621:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 163 00000100:00100000:3.0:1787548757.878806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548757.878941:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416164096 00000100:00100000:1.0:1787548757.878950:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416164096 00000100:00100000:1.0:1787548757.879006:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 164 00000100:00100000:1.0:1787548757.879028:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:11478:x1874380416164096:12345-192.168.206.13@tcp:34:lfs.0 00010000:00010000:1.0:1787548757.879100:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f34d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879117:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f34d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879158:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f34d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879175:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f354 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879183:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879190:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879277:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f35b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879286:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f35b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879293:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f35b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787548757.879331:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f35b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879343:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f34d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879357:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f34d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879364:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f34d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879369:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22ea00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548757.879373:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f34d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879380:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f34d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879391:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:1.0:1787548757.879394:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548757.879398:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f34d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879404:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f34d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879417:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879423:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f354 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879429:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f354 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879434:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548757.879443:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f354 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879449:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f354 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879458:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8feca2d51f00) 00010000:00010000:1.0:1787548757.879460:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548757.879463:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f354 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879469:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f354 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879482:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f35b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879489:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f35b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879495:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f35b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879499:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fa00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548757.879502:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f35b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879508:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f35b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879514:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:1.0:1787548757.879516:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548757.879524:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f35b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.879530:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f35b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548757.879601:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:11478:x1874380416164096:12345-192.168.206.13@tcp:34:lfs.0 Request processed in 574us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548757.879609:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 164 00000100:00100000:3.0:1787548757.884071:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548757.884179:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416164352 00000100:00100000:0.0:1787548757.884189:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416164352 00000100:00100000:0.0:1787548757.884237:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 46 00000100:00100000:0.0:1787548757.884247:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:11478:x1874380416164352:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:0.0:1787548757.884501:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+52:11478:x1874380416164352:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 255us (438us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787548757.884509:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 46 00000100:00100000:2.0:1787548757.924907:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548757.924982:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416164608 00000100:00100000:0.0:1787548757.924993:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416164608 00000100:00100000:0.0:1787548757.925054:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 165 00000100:00100000:0.0:1787548757.925065:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+52:11481:x1874380416164608:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548757.925089:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548757.925114:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f362 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a247b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925223:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f369 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925237:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f369 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925248:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f369 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925276:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f370 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925284:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925290:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925421:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f377 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925437:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925443:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548757.925453:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787548757.925542:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f369 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925550:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f369 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925557:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f369 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925562:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548757.925566:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f369 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925594:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f369 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925606:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:0.0:1787548757.925609:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548757.925613:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f369 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925623:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f369 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925635:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925642:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f370 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925648:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925653:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548757.925655:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925661:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f370 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925667:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548757.925669:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548757.925672:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f370 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925685:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f370 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925721:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f362 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a247b expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925733:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a247b expref: 54 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.925740:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:0.0:1787548757.925742:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548757.925745:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150e00, rc 0) 00000100:00100000:0.0:1787548757.925809:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:11481:x1874380416164608:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 746us (911us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787548757.925816:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 165 00000100:00100000:3.0:1787548757.928698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548757.929539:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548757.929824:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416164864 00000100:00100000:1.0:1787548757.929833:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416164864 00000100:00100000:1.0:1787548757.929886:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 166 00000100:00100000:1.0:1787548757.929896:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:11481:x1874380416164864:12345-192.168.206.13@tcp:54:lfs.0 00000100:00100000:0.0:1787548757.930010:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416164736 00000100:00100000:0.0:1787548757.930014:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416164736 00010000:00010000:1.0:1787548757.930031:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f385 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548757.930089:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 13 00000100:00100000:0.0:1787548757.930097:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:2352:x1874380416164736:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548757.930107:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548757.930126:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f377 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a247b expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548757.930168:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:0.0:1787548757.930172:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548757.930217:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:2352:x1874380416164736:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 121us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548757.930235:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 13 00010000:00010000:1.0:1787548757.931887:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.931901:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.931934:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.931941:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f385 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.931948:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.931953:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fa00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548757.931972:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.931979:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.931991:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:1.0:1787548757.931994:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787548757.931998:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f385 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548757.932004:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f385 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548757.932231:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+53:11481:x1874380416164864:12345-192.168.206.13@tcp:54:lfs.0 Request processed in 2333us (3537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548757.932241:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 166 00000100:00100000:3.0:1787548757.934589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548757.935435:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416165120 00000100:00100000:0.0:1787548757.935446:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416165120 00000100:00100000:0.0:1787548757.935557:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 47 00000100:00100000:0.0:1787548757.935567:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+53:11481:x1874380416165120:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:0.0:1787548757.936238:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:11481:x1874380416165120:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 670us (1663us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787548757.936246:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 47 00000100:00100000:3.0:1787548758.133806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548758.133887:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416165376 00000100:00100000:2.0:1787548758.133897:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416165376 00000100:00100000:2.0:1787548758.134114:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 167 00000100:00100000:2.0:1787548758.134157:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:11499:x1874380416165376:12345-192.168.206.13@tcp:101:cat.0 00010000:00010000:2.0:1787548758.134183:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548758.134202:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f38c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2482 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.134315:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f393 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.134329:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.134341:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548758.134352:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787548758.134466:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f38c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2482 expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.134485:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f393 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2482 expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.134499:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:2.0:1787548758.134502:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787548758.134506:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6200, rc 0) 00000100:00100000:2.0:1787548758.134567:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:11499:x1874380416165376:12345-192.168.206.13@tcp:101:cat.0 Request processed in 441us (770us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787548758.135304:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 167 00000100:00100000:3.0:1787548758.171920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548758.172033:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416165504 00000100:00100000:0.0:1787548758.172042:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416165504 00000100:00100000:0.0:1787548758.172095:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 168 00000100:00100000:0.0:1787548758.172103:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:11500:x1874380416165504:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548758.172125:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548758.172166:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f3a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2489 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.172224:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f3a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.172237:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.172247:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548758.172297:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787548758.172300:0:8467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548758.172332:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.172356:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f3a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2489 expref: 58 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.172371:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f3a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2489 expref: 57 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.172380:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:0.0:1787548758.172382:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787548758.172386:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150c00, rc 0) 00000100:00100000:0.0:1787548758.172441:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:11500:x1874380416165504:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 338us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548758.172447:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 168 00000100:00100000:3.0:1787548758.184644:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548758.184759:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416165888 00000100:00100000:0.0:1787548758.184769:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416165888 00000100:00100000:0.0:1787548758.184825:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 48 00000100:00100000:0.0:1787548758.184835:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:11500:x1874380416165888:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:0.0:1787548758.185377:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+58:11500:x1874380416165888:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 542us (739us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787548758.185385:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 48 00000100:00100000:3.0:1787548758.191679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548758.192261:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416166016 00000100:00100000:0.0:1787548758.192271:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416166016 00000100:00100000:0.0:1787548758.192386:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:0.0:1787548758.192398:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+58:11500:x1874380416166016:12345-192.168.206.13@tcp:103:lfs.0 00010000:00010000:0.0:1787548758.192417:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787548758.192451:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f338 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a246d expref: 58 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.192473:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f393 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2482 expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.192487:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f243 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a242e expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.192497:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93500) 00010000:00010000:0.0:1787548758.192507:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548758.192564:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:11500:x1874380416166016:12345-192.168.206.13@tcp:103:lfs.0 Request processed in 168us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548758.192583:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:3.0:1787548758.203328:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548758.203451:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416166144 00000100:00100000:0.0:1787548758.203461:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416166144 00000100:00100000:0.0:1787548758.203519:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 169 00000100:00100000:0.0:1787548758.203530:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:11500:x1874380416166144:12345-192.168.206.13@tcp:58:lfs.0 00010000:00010000:0.0:1787548758.203661:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f3af lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.203677:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f3af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.203688:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f3af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787548758.203890:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787548758.203989:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:11500:x1874380416166144:12345-192.168.206.13@tcp:58:lfs.0 Request processed in 460us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548758.204003:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 169 00000100:00100000:3.0:1787548758.243499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548758.244083:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416166272 00000100:00100000:0.0:1787548758.244092:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416166272 00000100:00100000:0.0:1787548758.244253:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 170 00000100:00100000:0.0:1787548758.244263:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:11502:x1874380416166272:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548758.244282:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548758.244299:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f3b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2490 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244356:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f3bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244369:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f3bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244379:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f3bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244393:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244399:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244405:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244497:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f3cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244521:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f3cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244528:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f3cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548758.244562:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787548758.244566:0:8467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548758.244596:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f3cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244607:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f3cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244616:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f3bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244623:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f3bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244630:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f3bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244636:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548758.244640:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f3bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244647:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f3bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244658:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:0.0:1787548758.244661:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548758.244672:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f3bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244677:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f3bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244690:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.244695:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.245296:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.245303:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548758.245307:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.245314:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.245325:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8feca2cf6000) 00010000:00010000:0.0:1787548758.245327:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548758.245330:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.245337:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.245373:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f3b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2490 expref: 57 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.245403:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f3cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2490 expref: 56 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.245411:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548758.245414:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787548758.245416:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150600, rc 0) 00000100:00100000:0.0:1787548758.245484:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:11502:x1874380416166272:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 1222us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548758.245491:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 170 00000040:00080000:3.0:1787548758.339935:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787548758.339955:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787548758.340003:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787548758.340010:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787548758.340172:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad63d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874380431890304:192.168.206.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787548758.340279:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1780 going to sleep for 11 seconds 00000100:00100000:2.0:1787548758.353565:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548758.353651:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad63d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874380431890304:192.168.206.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787548758.354012:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416166400 00000100:00100000:0.0:1787548758.354020:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416166400 00000100:00100000:0.0:1787548758.354072:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 171 00000100:00100000:0.0:1787548758.354081:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:11513:x1874380416166400:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787548758.354109:0:5855:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787548758.354235:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:11513:x1874380416166400:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 Request processed in 154us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548758.354244:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 171 00000100:00100000:2.0:1787548758.363475:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548758.364748:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416166528 00000100:00100000:1.0:1787548758.364760:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416166528 00000100:00100000:1.0:1787548758.364829:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 172 00000100:00100000:1.0:1787548758.364839:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:11513:x1874380416166528:12345-192.168.206.13@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787548758.364919:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f3d2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.364935:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.364946:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.364960:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f3d9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.364982:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.364988:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365014:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f3e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365022:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365028:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548758.365076:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787548758.365080:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787548758.365092:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365102:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365108:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f3d2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365115:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365121:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fa00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548758.365125:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365173:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f3d2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365185:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8feca2d51a00) 00010000:00010000:1.0:1787548758.365188:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548758.365193:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f3d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365199:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fa00/0xcb7c48919424f3d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365213:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365219:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f3d9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365225:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365230:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548758.365233:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365238:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f3d9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365244:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8feca2d51f00) 00010000:00010000:1.0:1787548758.365246:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548758.365248:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f3d9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365265:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f3d9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365278:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365284:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f3e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365291:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365635:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22ea00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548758.365638:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365644:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f3e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365652:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:1.0:1787548758.365655:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548758.365658:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f3e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.365664:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f3e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548758.365756:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:11513:x1874380416166528:12345-192.168.206.13@tcp:34:lhsmtool_posix.0 Request processed in 917us (2289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548758.365763:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 172 00000100:00100000:3.0:1787548758.378888:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548758.379630:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416166784 00000100:00100000:0.0:1787548758.379642:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416166784 00000100:00100000:0.0:1787548758.379709:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 173 00000100:00100000:0.0:1787548758.379720:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:11513:x1874380416166784:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787548758.379740:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548758.379759:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f3e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2497 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.379886:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.379901:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.379912:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548758.379923:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787548758.380019:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.380027:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.380046:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.380053:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548758.380057:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.380064:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.380077:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548758.380080:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787548758.380085:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.380101:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.380160:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f3e7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2497 expref: 58 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.380171:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8feca2d51a00) 00010000:00010000:0.0:1787548758.380174:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787548758.380178:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f3e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2497 expref: 58 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.380187:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150200, rc 0) 00000100:00100000:0.0:1787548758.380243:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:11513:x1874380416166784:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 524us (1363us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1787548758.380250:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 173 00000100:00100000:0.0:1787548758.398314:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548758.398673:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416166912 00000100:00100000:3.0:1787548758.398682:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416166912 00000100:00100000:3.0:1787548758.398748:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 174 00000100:00100000:3.0:1787548758.398759:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:11513:x1874380416166912:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787548758.398793:0:8467:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787548758.399038:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:11513:x1874380416166912:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 Request processed in 280us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548758.399047:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 174 00000100:00100000:3.0:1787548758.406326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548758.406549:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416167168 00000100:00100000:0.0:1787548758.406558:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416167168 00000100:00100000:0.0:1787548758.406624:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 175 00000100:00100000:0.0:1787548758.406633:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:11513:x1874380416167168:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787548758.406650:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548758.406653:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787548758.406676:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f3a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2489 expref: 57 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.406703:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:0.0:1787548758.406717:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787548758.406731:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a249e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787548758.407125:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787548758.407512:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f403 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.407525:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f403 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.407535:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f403 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.407598:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f3fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a249e expref: 59 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.407613:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f403 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a249e expref: 58 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.407621:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8feca2cf6000) 00010000:00010000:0.0:1787548758.407624:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548758.407626:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150800, rc 0) 00000100:00100000:0.0:1787548758.407683:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+58:11513:x1874380416167168:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 1050us (1365us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787548758.407690:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 175 00000100:00100000:0.0:1787548758.411072:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548758.411197:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416167424 00000100:00100000:1.0:1787548758.411207:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416167424 00000100:00100000:1.0:1787548758.411254:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 176 00000100:00100000:1.0:1787548758.411264:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+58:11513:x1874380416167424:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787548758.411332:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548758.411370:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f403 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a249e expref: 58 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411389:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8feca2cf6000) 00010000:00010000:1.0:1787548758.411397:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787548758.411418:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f411 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411430:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f411 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411439:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f411 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411496:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f418 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1b64c253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411504:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b64c253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411512:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b64c253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411590:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f411 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411614:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f411 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411619:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f411 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411625:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22ea00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548758.411629:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f411 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411636:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f411 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411645:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:1.0:1787548758.411647:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548758.411652:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f411 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411657:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f411 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411666:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b64c253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411672:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f418 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b64c253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411678:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f418 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b64c253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411683:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548758.411691:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f418 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b64c253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411710:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f418 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b64c253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411727:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1b64c253 (ffff8feca2d51f00) 00010000:00010000:1.0:1787548758.411729:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548758.411732:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f418 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1b64c253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.411737:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e800/0xcb7c48919424f418 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1b64c253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548758.411817:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:11513:x1874380416167424:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 554us (755us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787548758.411823:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 176 00000100:00100000:3.0:1787548758.414815:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548758.414937:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416167552 00000100:00100000:0.0:1787548758.414947:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416167552 00000100:00100000:0.0:1787548758.415012:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 177 00000100:00100000:0.0:1787548758.415022:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:11513:x1874380416167552:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787548758.415053:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548758.415074:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f41f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a24a5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.415108:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f426 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.415122:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.415155:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.415249:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f41f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24a5 expref: 59 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.415268:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24a5 expref: 58 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.415277:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:0.0:1787548758.415280:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787548758.415284:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150400, rc 0) 00000100:00100000:0.0:1787548758.415604:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+58:11513:x1874380416167552:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 582us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548758.415612:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 177 00000100:00100000:0.0:1787548758.421864:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548758.422627:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416167808 00000100:00100000:3.0:1787548758.422638:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416167808 00000100:00100000:3.0:1787548758.422707:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 178 00000100:00100000:3.0:1787548758.422718:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+58:11513:x1874380416167808:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787548758.422795:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f42d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.422813:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f42d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.422839:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f42d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787548758.423107:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1787548758.423118:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381299987122ns, next at 382299984666ns, rc = 0 00000004:00010000:3.0:1787548758.423216:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e471fe6 reply state 000000008528059f transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f42d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548758.423226:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787548758.423312:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:11513:x1874380416167808:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 595us (1453us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787548758.423320:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 178 00000100:00100000:3.0:1787548758.427836:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548758.428391:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416167936 00000100:00100000:1.0:1787548758.428401:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416167936 00000100:00100000:1.0:1787548758.428457:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 179 00000100:00100000:1.0:1787548758.428476:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:11513:x1874380416167936:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787548758.428499:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548758.428518:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f434 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a24ac expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.428584:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f434 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ac expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.428598:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f434 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ac expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.428629:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:1.0:1787548758.428632:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787548758.428635:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22ea00, rc 0) 00000100:00100000:1.0:1787548758.428685:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:11513:x1874380416167936:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 220us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548758.428691:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 179 00010000:00010000:0.0:1787548758.429893:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f42d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.429918:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f42d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.429926:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f42d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.429931:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548758.429935:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f42d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.429942:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f42d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.429955:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:0.0:1787548758.429958:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787548758.429962:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f42d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.429968:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f42d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548758.433583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548758.433814:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416168064 00000100:00100000:3.0:1787548758.433824:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416168064 00000100:00100000:3.0:1787548758.433941:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 50 00000100:00100000:3.0:1787548758.433951:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad560700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416168064:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787548758.434295:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad560700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2352:x1874380416168064:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 Request processed in 344us (730us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787548758.434304:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 50 00000100:00080000:2.0:1787548758.438744:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787548758.451019:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548758.451256:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416168320 00000100:00100000:3.0:1787548758.451267:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416168320 00000100:00100000:3.0:1787548758.451327:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 49 00000100:00100000:3.0:1787548758.451337:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:11513:x1874380416168320:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787548758.451555:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:11513:x1874380416168320:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 Request processed in 218us (544us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787548758.451585:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 49 00000100:00100000:1.0:1787548758.458381:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548758.458447:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416168576 00000100:00100000:3.0:1787548758.458456:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416168576 00000100:00100000:3.0:1787548758.458515:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 180 00000100:00100000:3.0:1787548758.458526:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:11513:x1874380416168576:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787548758.458643:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:11513:x1874380416168576:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 118us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548758.458652:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 180 00000100:00100000:2.0:1787548758.467263:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548758.467342:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416168704 00000100:00100000:0.0:1787548758.467352:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416168704 00000100:00100000:0.0:1787548758.467408:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 181 00000100:00100000:0.0:1787548758.467419:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:11513:x1874380416168704:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787548758.467438:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548758.467457:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f43b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a24b3 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.467534:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f442 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.467554:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.467565:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548758.467612:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548758.467629:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.467653:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f43b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24b3 expref: 63 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.467670:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24b3 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.467678:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:0.0:1787548758.467681:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787548758.467685:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150000, rc 0) 00000100:00100000:0.0:1787548758.467744:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+62:11513:x1874380416168704:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 326us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548758.467751:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 181 00010000:00010000:2.0:1787548758.468052:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548758.471380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548758.472186:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416168832 00000100:00100000:0.0:1787548758.472196:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416168832 00000100:00100000:0.0:1787548758.472242:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 51 00000100:00100000:0.0:1787548758.472253:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2351:x1874380416168832:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787548758.472269:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548758.472296:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cc7e695/0xcb7c48919424f449 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a24ba expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787548758.472325:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8bd457, blocks: 0x1 00010000:00010000:0.0:1787548758.472344:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1787548758.472348:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787548758.472357:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cc7e695/0xcb7c48919424f449 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ba expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.472375:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003cc7e695/0xcb7c48919424f449 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ba expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.472388:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151400, rc 0) 00000100:00100000:0.0:1787548758.472439:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2351:x1874380416168832:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 188us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548758.472446:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 51 00000100:00100000:0.0:1787548758.476858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548758.476925:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416169088 00000100:00100000:3.0:1787548758.476935:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416169088 00000100:00100000:3.0:1787548758.476991:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 182 00000100:00100000:3.0:1787548758.477001:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+62:11513:x1874380416169088:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787548758.477115:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+62:11513:x1874380416169088:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 114us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548758.477122:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 182 00000100:00100000:2.0:1787548758.483306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548758.483382:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416169216 00000100:00100000:3.0:1787548758.483391:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416169216 00000100:00100000:3.0:1787548758.483446:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 52 00000100:00100000:3.0:1787548758.483456:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:11513:x1874380416169216:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787548758.483485:0:10297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548758.483501:0:10297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f450 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a24c1 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.483532:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003cc7e695/0xcb7c48919424f449 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ba expref: 9 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.483553:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548758.483557:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548758.483563:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f450 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c1 expref: 9 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.483610:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003cc7e695/0xcb7c48919424f449 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ba expref: 9 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.483625:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003cc7e695/0xcb7c48919424f449 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ba expref: 9 pid: 6691 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548758.483638:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10297:1874380431890432:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548758.483719:0:10297:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec895839c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548758.500881:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548758.500965:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416169344 00000100:00100000:1.0:1787548758.500975:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416169344 00000100:00100000:3.0:1787548758.500990:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10297:1874380431890432:192.168.206.13@tcp:104: 00010000:00010000:1.0:1787548758.501013:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003cc7e695/0xcb7c48919424f449 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ba expref: 10 pid: 6691 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.501022:0:10297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f450 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c1 expref: 10 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.501053:0:10297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93a00, rc 0) 00000100:00100000:1.0:1787548758.501060:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 69 00000100:00100000:1.0:1787548758.501070:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:2352:x1874380416169344:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548758.501085:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787548758.501107:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:11513:x1874380416169216:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 17650us (17806us total) trans 0 rc 0/0 00010000:00010000:1.0:1787548758.501115:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003cc7e695/0xcb7c48919424f449 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ba expref: 10 pid: 6691 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548758.501116:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 52 00010000:00010000:1.0:1787548758.501151:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003cc7e695/0xcb7c48919424f449 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ba expref: 10 pid: 6691 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.501178:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cc7e695/0xcb7c48919424f449 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ba expref: 9 pid: 6691 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.501204:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548758.501208:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548758.501216:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f450 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c1 expref: 8 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.501225:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c1 expref: 8 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.501265:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c1 expref: 8 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548758.501278:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5840:1874380431890560:192.168.206.13@tcp:105: 00000100:00100000:1.0:1787548758.502601:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ecb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787548758.509943:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548758.509975:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416169472 00000100:00100000:2.0:1787548758.509984:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416169472 00002000:00100000:2.0:1787548758.510029:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8fecbcef7100 x1874380416169472/t0(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:199/0 lens 504/0 e 0 to 0 dl 1787548769 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787548758.510040:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fecbcef7100 with x1874380416169472 ext(0->8) 00002000:00010000:2.0:1787548758.510045:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fecbcef7100 00000100:00100000:2.0:1787548758.510071:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 4 00000100:00100000:2.0:1787548758.510080:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2351:x1874380416169472:12345-192.168.206.13@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787548758.510598:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5840:1874380431890560:192.168.206.13@tcp:105: 00010000:00010000:0.0:1787548758.510619:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548758.510665:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:2352:x1874380416169344:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 9596us (9792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548758.510674:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 69 00000100:00100000:2.0:1787548758.512006:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:2351:x1874380416169472:12345-192.168.206.13@tcp:4:lhsmtool_posix.0 Request processed in 1921us (2067us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787548758.512026:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 4 00002000:00100000:2.0:1787548758.512036:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8fecbcef7100 x1874380416169472/t4294967314(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:199/0 lens 504/448 e 0 to 0 dl 1787548769 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787548758.512045:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fecbcef7100 with x1874380416169472 ext(0->8) 00002000:00010000:2.0:1787548758.512050:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fecbcef7100 00000100:00100000:2.0:1787548758.515667:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548758.519329:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416169600 00000100:00100000:0.0:1787548758.519343:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416169600 00000100:00100000:0.0:1787548758.519454:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 183 00000100:00100000:0.0:1787548758.520928:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+62:11513:x1874380416169600:12345-192.168.206.13@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787548758.575273:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1787548758.575291:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1787548758.582853:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:3.0:1787548758.582892:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:2.0:1787548758.583088:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431890688:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787548758.583292:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+50:11513:x1874380416169600:12345-192.168.206.13@tcp:44:lhsmtool_posix.0 Request processed in 63608us (67413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548758.583305:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 183 00000100:00100000:2.0:1787548758.585324:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548758.585614:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431890688 00000100:00100000:0.0:1787548758.585623:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431890688 00000100:00100000:0.0:1787548758.585691:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787548758.585701:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431890688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787548758.585741:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1787548758.585772:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8bd454, atime: 0x6a8bd455, ctime: 0x6a8bd454, blocks: 0xb 00010000:00010000:0.0:1787548758.585781:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095765f25/0xcb7c48919424f457 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.585796:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1787548758.585801:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787548758.585806:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095765f25/0xcb7c48919424f457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.585823:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095765f25/0xcb7c48919424f457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.585834:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095765f25/0xcb7c48919424f457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.585842:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095765f25/0xcb7c48919424f457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.585876:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787548758.586618:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1874380431890688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 917us (1297us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787548758.586627:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787548758.586840:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1787548758.586846:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1787548758.586868:0:3314:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8fecad099c00 x1874380431890688/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787548774 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787548758.586879:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fecad099c00/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787548758.586884:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431890688:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1787548758.586951:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787548758.586961:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548758.586968:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095765f25/0xcb7c48919424f457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.586978:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150c00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548758.586983:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095765f25/0xcb7c48919424f457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.586994:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095765f25/0xcb7c48919424f457 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.587021:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095765f25/0xcb7c48919424f457 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.587029:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095765f25/0xcb7c48919424f457 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.587047:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548758.587049:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548758.587051:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787548758.587385:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fec837f16c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787548758.587396:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fec8561a000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8feca2df1f00 00000020:00080000:3.0:1787548758.587399:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fec8561a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fecb4480400 00000001:00080000:3.0:1787548758.587444:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1787548758.587453:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1787548758.587640:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787548758.587814:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787548758.588109:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787548758.588126:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431890816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787548758.588212:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548758.588307:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431890816 00000100:00100000:1.0:1787548758.588313:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431890816 00000100:00100000:1.0:1787548758.588367:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787548758.588375:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431890816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787548758.588635:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787548758.588639:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787548759 00002000:00010000:1.0:1787548758.588641:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787548758.588643:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787548759 -> 1787548759 00002000:00010000:1.0:1787548758.588646:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787548758.588688:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1874380431890816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 313us (476us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787548758.588695:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1787548758.588799:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fecad561180/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787548758.588805:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431890816:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1787548758.588851:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787548758.589833:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548758.589973:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416169728 00000100:00100000:3.0:1787548758.589980:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416169728 00000100:00100000:3.0:1787548758.590062:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 55 00000100:00100000:3.0:1787548758.590072:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:2353:x1874380416169728:12345-192.168.206.13@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787548758.635733:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1787548758.635753:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:2.0:1787548758.640007:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2353:x1874380416169728:12345-192.168.206.13@tcp:16:lhsmtool_posix.0 Request processed in 49926us (50168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548758.640021:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 55 00000100:00100000:3.0:1787548758.647029:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548758.647061:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416169984 00000100:00100000:3.0:1787548758.647069:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416169984 00000100:00100000:3.0:1787548758.647115:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 184 00000100:00100000:3.0:1787548758.647123:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:11513:x1874380416169984:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787548758.647183:0:8467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548758.647207:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f442 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24b3 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.647225:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:3.0:1787548758.647229:0:8467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787548758.647257:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f45e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.647271:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f45e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.647280:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f45e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787548758.647530:0:8467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c32fefd3 reply state 0000000020e3014e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f45e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548758.647539:0:8467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787548758.647637:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:11513:x1874380416169984:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 513us (615us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787548758.647644:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 184 00000100:00100000:3.0:1787548758.650983:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548758.651418:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416170112 00000100:00100000:1.0:1787548758.651433:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416170112 00000100:00100000:1.0:1787548758.651654:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 56 00000100:00100000:1.0:1787548758.651666:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2351:x1874380416170112:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787548758.651908:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787548758.651912:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787548759 -> 1787548758 00002000:00010000:1.0:1787548758.651915:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787548757 00002000:00010000:1.0:1787548758.651917:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787548759 -> 1787548758 00002000:00010000:1.0:1787548758.651919:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787548758.651984:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2351:x1874380416170112:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 Request processed in 319us (1009us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787548758.651990:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 56 00010000:00010000:0.0:1787548758.652374:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f45e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.652385:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f45e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.652393:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f45e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.652399:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548758.652403:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f45e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.652410:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f45e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.652425:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:0.0:1787548758.652437:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548758.652442:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f45e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.652448:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f45e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548758.658115:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548758.658168:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416170368 00000100:00100000:3.0:1787548758.658176:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416170368 00000100:00100000:3.0:1787548758.658221:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 185 00000100:00100000:3.0:1787548758.658231:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:11513:x1874380416170368:12345-192.168.206.13@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787548758.658294:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.658312:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f426 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24a5 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.658322:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.658355:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24a5 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.658368:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f426 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24a5 expref: 18 pid: 5855 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548758.658398:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad1fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1874380431890944:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548758.658904:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec300 going to sleep for 11 seconds 00000100:00100000:0.0:1787548758.661658:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad1fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1874380431890944:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548758.661682:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548758.664077:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548758.664708:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416170496 00000100:00100000:2.0:1787548758.664835:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416170496 00010000:00010000:2.0:1787548758.664881:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f426 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24a5 expref: 19 pid: 5855 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548758.664968:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 70 00000100:00100000:2.0:1787548758.664978:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:2353:x1874380416170496:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548758.665008:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548758.665018:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f426 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24a5 expref: 19 pid: 5855 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.665031:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24a5 expref: 19 pid: 5855 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.665052:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f426 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24a5 expref: 19 pid: 5855 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.665068:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:2.0:1787548758.665073:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.665082:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.665090:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.665122:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787548758.665228:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.665235:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.665262:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.665268:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.665276:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.665281:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548758.665285:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.665293:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.665302:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:3.0:1787548758.665305:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787548758.665308:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.665326:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f465 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548758.665408:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:11513:x1874380416170368:12345-192.168.206.13@tcp:55:lhsmtool_posix.0 Request processed in 7177us (7299us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787548758.665417:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 185 00000100:00100000:3.0:1787548758.667923:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548758.668219:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416170624 00000100:00100000:2.0:1787548758.668227:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416170624 00000100:00100000:2.0:1787548758.668279:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 57 00000100:00100000:2.0:1787548758.668288:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2353:x1874380416170624:12345-192.168.206.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787548758.668326:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007bea9a07/0xcb7c48919424f46c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.668345:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f450 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c1 expref: 8 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.668364:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548758.668368:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787548758.668372:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bea9a07/0xcb7c48919424f46c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.668404:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c1 expref: 8 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.668416:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c1 expref: 8 pid: 10297 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548758.668431:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad71dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1874380431891072:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548758.668506:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787548758.670687:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad71dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1874380431891072:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548758.670727:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007bea9a07/0xcb7c48919424f46c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548758.671362:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:2353:x1874380416170496:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 6380us (7286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548758.671375:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 70 00000100:00100000:3.0:1787548758.678876:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548758.679186:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416170752 00000100:00100000:0.0:1787548758.679195:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416170752 00010000:00010000:0.0:1787548758.679236:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c1 expref: 9 pid: 10297 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548758.679269:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 71 00000100:00100000:0.0:1787548758.679278:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2352:x1874380416170752:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548758.679293:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548758.679316:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c1 expref: 9 pid: 10297 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.679329:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c1 expref: 9 pid: 10297 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.679351:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f450 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c1 expref: 9 pid: 10297 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.679383:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787548758.679387:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787548758.679393:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007bea9a07/0xcb7c48919424f46c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.679403:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bea9a07/0xcb7c48919424f46c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.679436:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787548758.679625:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007bea9a07/0xcb7c48919424f46c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.679635:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bea9a07/0xcb7c48919424f46c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.679657:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007bea9a07/0xcb7c48919424f46c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.679665:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bea9a07/0xcb7c48919424f46c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.679672:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bea9a07/0xcb7c48919424f46c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.679679:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7200 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548758.679683:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bea9a07/0xcb7c48919424f46c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.679703:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bea9a07/0xcb7c48919424f46c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.679726:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bea9a07/0xcb7c48919424f46c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.679735:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bea9a07/0xcb7c48919424f46c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548758.679806:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2352:x1874380416170752:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 528us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548758.679813:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 71 00000100:00100000:3.0:1787548758.680909:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2353:x1874380416170624:12345-192.168.206.13@tcp:1:lhsmtool_posix.0 Request processed in 12617us (12989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548758.680919:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 57 00000100:00100000:3.0:1787548758.683523:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548758.683630:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416171008 00000100:00100000:1.0:1787548758.683638:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416171008 00000100:00100000:1.0:1787548758.683689:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 186 00000100:00100000:1.0:1787548758.683699:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+17:11513:x1874380416171008:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787548758.683791:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f473 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.683808:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.683819:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.684012:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.684039:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f434 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ac expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.684047:0:8467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.684079:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f434 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ac expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.684093:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f434 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ac expref: 18 pid: 5856 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548758.684107:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad563100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431891200:192.168.206.13@tcp:104: 00000100:00100000:1.0:1787548758.684473:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec883813c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548758.687180:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548758.687262:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad563100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431891200:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548758.687288:0:8467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548758.690098:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416171136 00000100:00100000:0.0:1787548758.690111:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416171136 00010000:00010000:0.0:1787548758.690206:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f434 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ac expref: 19 pid: 5856 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548758.690238:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 72 00000100:00100000:0.0:1787548758.690248:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad562680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:2351:x1874380416171136:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548758.690262:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548758.690269:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f434 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ac expref: 19 pid: 5856 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.690283:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f434 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ac expref: 19 pid: 5856 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.690316:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ea00/0xcb7c48919424f434 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24ac expref: 19 pid: 5856 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.690329:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:0.0:1787548758.690334:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.690342:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.690348:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.690371:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548758.690419:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad562680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:2351:x1874380416171136:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 173us (3249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548758.690427:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 72 00010000:00010000:3.0:1787548758.690624:0:8467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.690633:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787548758.690815:0:8467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787548758.690940:0:8467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787548758.690978:0:8467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787548758.691070:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad1fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8467:1874380431891328:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787548758.691116:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548758.691167:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ecb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787548758.692381:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431891328 00000100:00100000:0.0:1787548758.692390:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431891328 00000100:00100000:0.0:1787548758.692439:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787548758.692448:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8467:x1874380431891328:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787548758.692577:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8467:x1874380431891328:12345-0@lo:1000:mdt00_003.0 Request processed in 119us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548758.692586:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787548758.692659:0:8467:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787548758.692665:0:8467:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fecad561180, transno 4294967315 00000100:00100000:1.0:1787548758.692682:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad1fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8467:1874380431891328:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787548758.693113:0:8467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787548758.693215:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8467:1874380431891456:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787548758.693254:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548758.693276:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787548758.693296:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431891456 00000100:00100000:1.0:1787548758.693300:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431891456 00000100:00100000:1.0:1787548758.693322:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787548758.693329:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8467:x1874380431891456:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787548758.693475:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8467:x1874380431891456:12345-0@lo:1000:mdt00_003.0 Request processed in 146us (220us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787548758.693482:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787548758.693511:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8467:1874380431891456:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787548758.693536:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693545:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693553:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693558:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fe00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548758.693562:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693580:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693594:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:1.0:1787548758.693597:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787548758.693601:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693607:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f47a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693632:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f3af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693647:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f3af lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693653:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f3af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693658:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548758.693660:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f3af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693666:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f3af lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693673:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:1.0:1787548758.693675:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787548758.693678:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f3af lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693684:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f3af lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693701:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693714:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f3cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2490 expref: 21 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693723:0:8467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693743:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f3cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2490 expref: 21 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548758.693759:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f3cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2490 expref: 21 pid: 8467 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548758.693770:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad563100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431891584:192.168.206.13@tcp:104: 00000100:00100000:1.0:1787548758.693819:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d2e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548758.697683:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548758.697852:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416171264 00000100:00100000:0.0:1787548758.697861:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416171264 00010000:00010000:0.0:1787548758.697898:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f3cb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2490 expref: 22 pid: 8467 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548758.697956:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 73 00000100:00100000:0.0:1787548758.697966:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad561500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+22:2351:x1874380416171264:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548758.697980:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548758.697987:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f3cb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2490 expref: 22 pid: 8467 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.698000:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f3cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2490 expref: 22 pid: 8467 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.698023:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548758.698028:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.698038:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.698045:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.698061:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548758.698104:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad561500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+22:2351:x1874380416171264:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 140us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548758.698111:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 73 00010000:00010000:3.0:1787548758.698323:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f3cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2490 expref: 21 pid: 8467 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548758.698343:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad563100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431891584:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548758.698363:0:8467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698372:0:8467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698377:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698389:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698395:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698403:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698409:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548758.698413:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698420:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698440:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:3.0:1787548758.698443:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548758.698446:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698453:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f481 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698464:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698470:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f473 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698475:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f473 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698480:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22ec00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548758.698483:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f473 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698489:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f473 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698495:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:3.0:1787548758.698498:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787548758.698501:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f473 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.698507:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f473 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787548758.699274:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787548758.699280:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787548758.700465:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:11513:x1874380416171008:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 16758us (16940us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787548758.700479:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 186 00000020:00080000:0.0:1787548758.700498:0:8467:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787548758.701355:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787548758.701367:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787548758.721379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548758.723407:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416171520 00000100:00100000:2.0:1787548758.723421:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416171520 00000100:00100000:2.0:1787548758.723483:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 50 00000100:00100000:2.0:1787548758.723494:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca6f16850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:11513:x1874380416171520:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787548758.724335:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787548758.724442:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1787548758.730886:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f488 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.730909:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f488 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.730920:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f488 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.730928:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f488 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.730935:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f488 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.730942:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f488 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548758.731008:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787548758.731113:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca6f16850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+22:11513:x1874380416171520:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 Request processed in 7617us (9740us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787548758.731122:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 50 00000020:00080000:0.0:1787548758.731146:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787548758.736450:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548758.736486:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f488 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.736497:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151400 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548758.736502:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f488 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.736512:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f488 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.736530:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8feca2cf6300) 00010000:00010000:2.0:1787548758.736533:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787548758.736538:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f488 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548758.736544:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f488 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548758.738479:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548758.738485:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548758.738488:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787548759.007891:0:12466:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787548759.007901:0:12466:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787548759.007934:0:12466:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787548759.007940:0:12466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787548759.094632:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.094672:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.094699:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.094737:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416171904 00000100:00100000:3.0:1787548759.094746:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416171904 00000100:00100000:3.0:1787548759.094801:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 143 00000100:00100000:3.0:1787548759.094812:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2353:x1874380416171904:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548759.094877:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+5:2353:x1874380416171904:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 67us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548759.094885:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 143 00000100:00100000:3.0:1787548759.094906:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416171776 00000100:00100000:3.0:1787548759.094910:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416171776 00000100:00100000:3.0:1787548759.094938:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 69 00000100:00100000:3.0:1787548759.094945:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416171776:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548759.094971:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416171776:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548759.094977:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 69 00000100:00080000:3.0:1787548759.094993:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787548759.094997:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548759.095117:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416171648 00000100:00100000:2.0:1787548759.095121:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416171648 00000100:00100000:2.0:1787548759.095179:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 290 00000100:00100000:2.0:1787548759.095187:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2353:x1874380416171648:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548759.095215:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2353:x1874380416171648:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 30us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548759.095222:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 290 00000100:00100000:3.0:1787548759.103625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.103659:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416172160 00000100:00100000:3.0:1787548759.103667:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416172160 00000100:00100000:3.0:1787548759.103739:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 187 00000100:00100000:3.0:1787548759.103750:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+22:11523:x1874380416172160:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548759.103777:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548759.103797:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f48f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a24c8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.104040:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f496 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.104054:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f496 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.104064:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f496 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548759.104075:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787548759.104269:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f48f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c8 expref: 25 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.104286:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f496 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c8 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.104295:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:3.0:1787548759.104298:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787548759.104301:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93200, rc 0) 00000100:00100000:3.0:1787548759.104354:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+24:11523:x1874380416172160:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 606us (738us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787548759.104371:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 187 00000100:00080000:3.0:1787548759.104398:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787548759.107041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.107103:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416172288 00000100:00100000:3.0:1787548759.107113:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416172288 00000100:00100000:3.0:1787548759.107219:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 188 00000100:00100000:3.0:1787548759.107229:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+24:11523:x1874380416172288:12345-192.168.206.13@tcp:34:lfs.0 00010000:00010000:3.0:1787548759.107297:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f4a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107313:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f4a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107325:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f4a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107341:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f4ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107348:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f4ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107354:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f4ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107663:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107672:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107679:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787548759.107863:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107877:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f4a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107883:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f4a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107891:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f4a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107896:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548759.107900:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f4a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107907:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f4a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107919:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:3.0:1787548759.107922:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548759.107927:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f4a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107933:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f4a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107944:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f4ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107950:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f4ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107962:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f4ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107967:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548759.107970:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f4ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107976:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f4ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107984:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fec90d93b00) 00010000:00010000:3.0:1787548759.107986:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548759.107989:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f4ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.107995:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93a00/0xcb7c48919424f4ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.108009:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.108016:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.108021:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.108026:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548759.108029:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.108043:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.108050:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec90d93300) 00010000:00010000:3.0:1787548759.108053:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548759.108056:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.108061:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548759.108245:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+24:11523:x1874380416172288:12345-192.168.206.13@tcp:34:lfs.0 Request processed in 1016us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548759.108254:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 188 00000100:00100000:2.0:1787548759.201295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548759.202042:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416172544 00000100:00100000:2.0:1787548759.202054:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416172544 00000100:00100000:2.0:1787548759.202110:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 189 00000100:00100000:2.0:1787548759.202202:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+24:11526:x1874380416172544:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548759.202231:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548759.202251:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f4b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a24cf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.202321:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f4c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.202336:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.202349:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.202363:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.202370:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.202377:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.202849:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f4ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.202858:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f4ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.202866:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f4ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548759.202875:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787548759.202970:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.202978:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f4c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.202984:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f4c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.202989:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548759.202993:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f4c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.202999:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f4c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.203011:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:2.0:1787548759.203014:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548759.203018:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f4c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.203023:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f4c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.203033:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.203039:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.203044:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.203048:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548759.203056:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.203061:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.203069:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fec87ceb400) 00010000:00010000:2.0:1787548759.203071:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548759.203073:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.203078:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.203115:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f4b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24cf expref: 27 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.203205:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f4ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24cf expref: 26 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.203213:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec87cebb00) 00010000:00010000:2.0:1787548759.203215:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548759.203218:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6000, rc 0) 00000100:00100000:2.0:1787548759.203284:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+26:11526:x1874380416172544:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 1166us (2000us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787548759.203292:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 189 00000100:00100000:0.0:1787548759.207229:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.207462:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416172672 00000100:00100000:3.0:1787548759.207472:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416172672 00000100:00100000:3.0:1787548759.207533:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 190 00000100:00100000:3.0:1787548759.207543:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+26:11526:x1874380416172672:12345-192.168.206.13@tcp:54:lfs.0 00010000:00010000:3.0:1787548759.207615:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.207630:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.207641:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.207666:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.207683:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.207689:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.207695:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548759.207699:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.207706:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.207925:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec87cebb00) 00010000:00010000:3.0:1787548759.207930:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787548759.207935:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.207942:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548759.208052:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+26:11526:x1874380416172672:12345-192.168.206.13@tcp:54:lfs.0 Request processed in 510us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548759.208060:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 190 00000100:00100000:2.0:1787548759.229105:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548759.229698:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416172928 00000100:00100000:0.0:1787548759.229775:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416172928 00000100:00100000:0.0:1787548759.229870:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 51 00000100:00100000:0.0:1787548759.229893:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+26:11526:x1874380416172928:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:0.0:1787548759.230106:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+27:11526:x1874380416172928:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 215us (1008us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787548759.230115:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 51 00000100:00100000:0.0:1787548759.291294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548759.291404:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416173184 00000100:00100000:2.0:1787548759.291415:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416173184 00000100:00100000:2.0:1787548759.291476:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 191 00000100:00100000:2.0:1787548759.291499:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+27:11060:x1874380416173184:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:2.0:1787548759.291524:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548759.291544:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f4e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a24d6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.291656:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.291670:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f4ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24cf expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.291678:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.291712:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f4ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24cf expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.291726:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f4ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24cf expref: 28 pid: 5854 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548759.291756:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a85500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431891712:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548759.292435:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787548759.295688:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a85500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431891712:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548759.295848:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548759.296088:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548759.296245:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416173312 00000100:00100000:0.0:1787548759.296252:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416173312 00010000:00010000:0.0:1787548759.296288:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f4ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24cf expref: 29 pid: 5854 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548759.296327:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 74 00000100:00100000:0.0:1787548759.296337:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+29:2351:x1874380416173312:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548759.296351:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548759.296358:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f4ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24cf expref: 29 pid: 5854 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.296371:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f4ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24cf expref: 29 pid: 5854 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.296392:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f4ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24cf expref: 29 pid: 5854 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.296407:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec87cebb00) 00010000:00010000:0.0:1787548759.296412:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.296423:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.296444:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.296481:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548759.296530:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+28:2351:x1874380416173312:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 194us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548759.296537:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 74 00010000:00010000:2.0:1787548759.296924:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.296940:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548759.296957:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787548759.297099:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f4e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24d6 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.297116:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24d6 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.297124:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec87cebb00) 00010000:00010000:2.0:1787548759.297178:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787548759.297182:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6200, rc 0) 00000100:00100000:2.0:1787548759.297213:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+28:11060:x1874380416173184:12345-192.168.206.13@tcp:101:bash.0 Request processed in 5716us (5929us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787548759.297220:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 191 00000100:00100000:0.0:1787548759.300321:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.300453:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416173568 00000100:00100000:3.0:1787548759.300472:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416173568 00000100:00100000:3.0:1787548759.300530:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 192 00000100:00100000:3.0:1787548759.300539:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+28:11060:x1874380416173568:12345-192.168.206.13@tcp:36:bash.0 00010000:00010000:3.0:1787548759.300929:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.300955:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.300967:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787548759.301022:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787548759.301045:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012e2f677 reply state 000000004d93f6bc transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548759.301054:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787548759.301096:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787548759.301467:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+32:11060:x1874380416173568:12345-192.168.206.13@tcp:36:bash.0 Request processed in 927us (1155us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787548759.301476:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 192 00000020:00080000:3.0:1787548759.301480:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787548759.304390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548759.304457:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416173696 00000100:00100000:2.0:1787548759.304474:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416173696 00000100:00100000:2.0:1787548759.304529:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 193 00000100:00100000:2.0:1787548759.304539:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+32:11060:x1874380416173696:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:2.0:1787548759.304571:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548759.304591:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f4ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a24dd expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.304648:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f4ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24dd expref: 33 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.304682:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f4ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24dd expref: 33 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.304703:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec87cebb00) 00010000:00010000:2.0:1787548759.304706:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787548759.304709:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7e00, rc 0) 00000100:00100000:2.0:1787548759.304780:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+33:11060:x1874380416173696:12345-192.168.206.13@tcp:101:bash.0 Request processed in 242us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548759.304787:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 193 00010000:00010000:3.0:1787548759.307274:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.307289:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.307296:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.307302:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548759.307306:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.307314:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.307351:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec87cebb00) 00010000:00010000:3.0:1787548759.307354:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548759.307359:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.307365:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f4f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548759.307703:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.307896:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416173824 00000100:00100000:3.0:1787548759.307905:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416173824 00000100:00100000:3.0:1787548759.307988:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 58 00000100:00100000:3.0:1787548759.307998:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:11060:x1874380416173824:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:3.0:1787548759.308015:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548759.308033:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f506 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a24e4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787548759.308059:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8bd456, atime: 0x6a8bd455, ctime: 0x6a8bd456, blocks: 0xb 00010000:00010000:3.0:1787548759.308080:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:3.0:1787548759.308084:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548759.308092:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24e4 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.308108:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24e4 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.308120:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93a00, rc 0) 00000100:00100000:3.0:1787548759.308255:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:11060:x1874380416173824:12345-192.168.206.13@tcp:101:bash.0 Request processed in 257us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548759.308269:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 58 00000100:00100000:1.0:1787548759.311242:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548759.311391:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416173952 00000100:00100000:2.0:1787548759.311400:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416173952 00002000:00010000:2.0:1787548759.311440:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787548759.311445:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fecad562a00 with x1874380416173952 ext(0->18446744073709551615) 00002000:00010000:2.0:1787548759.311457:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fecad562a00. 00000100:00100000:2.0:1787548759.311526:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 5 00000100:00100000:2.0:1787548759.311537:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2352:x1874380416173952:12345-192.168.206.13@tcp:10:bash.0 00002000:00010000:2.0:1787548759.311828:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787548759.311832:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787548758 -> 1787548760 00002000:00010000:2.0:1787548759.311835:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787548757 -> 1787548757 00002000:00010000:2.0:1787548759.311838:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787548758 -> 1787548760 00002000:00010000:2.0:1787548759.311840:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787548759.311903:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2352:x1874380416173952:12345-192.168.206.13@tcp:10:bash.0 Request processed in 368us (669us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787548759.311911:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 5 00002000:00010000:2.0:1787548759.311927:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787548759.311930:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fecad562a00 with x1874380416173952 ext(0->18446744073709551615) 00002000:00010000:2.0:1787548759.311935:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fecad562a00. 00000100:00100000:1.0:1787548759.401471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.401599:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416174080 00000100:00100000:3.0:1787548759.401608:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416174080 00000100:00100000:3.0:1787548759.401671:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 194 00000100:00100000:3.0:1787548759.401682:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+32:11540:x1874380416174080:12345-192.168.206.13@tcp:34:lfs.0 00010000:00010000:3.0:1787548759.401768:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f50d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.401786:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f50d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.401796:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f50d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.401811:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f514 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.401818:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.401824:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402119:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f51b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402167:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f51b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402177:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f51b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787548759.402228:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f51b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402240:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f50d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402246:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f50d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402254:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f50d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402260:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548759.402263:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f50d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402271:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f50d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402285:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:3.0:1787548759.402288:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548759.402292:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f50d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402297:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f50d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402309:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402315:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f514 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402326:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402331:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548759.402334:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402341:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f514 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402348:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fec90d93800) 00010000:00010000:3.0:1787548759.402351:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548759.402353:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f514 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402359:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f514 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402374:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f51b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402380:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f51b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402385:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f51b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402390:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548759.402393:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f51b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402408:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f51b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402417:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec87cebb00) 00010000:00010000:3.0:1787548759.402419:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548759.402422:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f51b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.402428:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f51b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548759.402522:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+32:11540:x1874380416174080:12345-192.168.206.13@tcp:34:lfs.0 Request processed in 840us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548759.402530:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 194 00000100:00100000:3.0:1787548759.437964:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548759.438124:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416174336 00000100:00100000:2.0:1787548759.438197:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416174336 00000100:00100000:2.0:1787548759.438257:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 195 00000100:00100000:2.0:1787548759.438268:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+32:11543:x1874380416174336:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548759.438294:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548759.438313:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f522 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a24eb expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.438390:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f529 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.438403:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f529 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.438414:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f529 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.438426:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f530 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.438445:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.438451:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439588:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f537 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439608:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439618:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548759.439630:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787548759.439714:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f529 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439723:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f529 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439784:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f529 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439791:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548759.439795:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f529 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439803:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f529 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439816:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:2.0:1787548759.439818:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548759.439823:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f529 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439828:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f529 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439841:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439853:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f530 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439860:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439865:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548759.439868:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439874:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f530 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439883:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fec87ceb400) 00010000:00010000:2.0:1787548759.439885:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548759.439888:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f530 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439893:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f530 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439932:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f522 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24eb expref: 35 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439944:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24eb expref: 34 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.439953:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec87cebb00) 00010000:00010000:2.0:1787548759.439955:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787548759.439963:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7600, rc 0) 00000100:00100000:2.0:1787548759.440048:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+34:11543:x1874380416174336:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 1781us (2092us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787548759.440056:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 195 00000100:00100000:1.0:1787548759.445090:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.445602:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416174464 00000100:00100000:3.0:1787548759.445612:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416174464 00000100:00100000:3.0:1787548759.446530:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 196 00000100:00100000:3.0:1787548759.446547:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+34:11543:x1874380416174464:12345-192.168.206.13@tcp:54:lfs.0 00010000:00010000:3.0:1787548759.447096:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.447115:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24d6 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.447126:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.447328:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24d6 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.447356:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24d6 expref: 34 pid: 5854 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548759.447372:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad1fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1874380431891840:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548759.447637:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec180 going to sleep for 11 seconds 00000100:00100000:1.0:1787548759.453108:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.453509:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad1fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1874380431891840:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548759.453535:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548759.454103:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416174720 00000100:00100000:0.0:1787548759.454112:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416174720 00000100:00100000:0.0:1787548759.454239:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 52 00000100:00100000:0.0:1787548759.454250:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+35:5593:x1874380416174720:12345-192.168.206.13@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787548759.454592:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+36:5593:x1874380416174720:12345-192.168.206.13@tcp:35:ldlm_bl.0 Request processed in 342us (1492us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787548759.454600:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 52 00000100:00100000:2.0:1787548759.456979:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.457171:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416174848 00000100:00100000:3.0:1787548759.457180:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416174848 00010000:00010000:3.0:1787548759.457221:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24d6 expref: 36 pid: 5854 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548759.457267:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 75 00000100:00100000:3.0:1787548759.457277:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+36:2351:x1874380416174848:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548759.457293:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548759.457300:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24d6 expref: 36 pid: 5854 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.457314:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24d6 expref: 36 pid: 5854 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.457335:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f4ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24d6 expref: 36 pid: 5854 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.457370:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec87cebb00) 00010000:00010000:3.0:1787548759.457375:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.457383:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.457391:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.457416:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548759.457480:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+35:2351:x1874380416174848:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 203us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548759.457488:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 75 00010000:00010000:3.0:1787548759.457540:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.457548:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.457589:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.457597:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.457604:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.457610:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548759.457621:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.457628:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.457638:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec87cebb00) 00010000:00010000:3.0:1787548759.457641:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787548759.457644:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.457651:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f545 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548759.457686:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+34:11543:x1874380416174464:12345-192.168.206.13@tcp:54:lfs.0 Request processed in 11145us (12605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548759.457694:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 196 00000100:00100000:2.0:1787548759.460418:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548759.460879:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416175104 00000100:00100000:1.0:1787548759.460889:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416175104 00000100:00100000:1.0:1787548759.460929:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 53 00000100:00100000:1.0:1787548759.460937:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+34:11543:x1874380416175104:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:1.0:1787548759.461272:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+35:11543:x1874380416175104:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 334us (860us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787548759.461280:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 53 00010000:00010000:1.0:1787548759.491632:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548759.557277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548759.557386:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416175360 00000100:00100000:0.0:1787548759.557396:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416175360 00000100:00100000:0.0:1787548759.557571:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 197 00000100:00100000:0.0:1787548759.557583:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+35:11554:x1874380416175360:12345-192.168.206.13@tcp:101:cat.0 00010000:00010000:0.0:1787548759.557606:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548759.557627:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f54c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a24f2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.557701:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f553 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.557753:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f553 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.557766:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f553 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.557781:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f55a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.557789:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f55a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.557796:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f55a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558121:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f561 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558152:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558160:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548759.558169:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787548759.558257:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f553 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558265:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f553 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558271:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f553 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558285:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548759.558290:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f553 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558297:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f553 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558309:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:0.0:1787548759.558312:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548759.558317:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f553 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558323:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f553 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558334:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f55a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558339:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f55a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558345:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f55a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558350:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548759.558353:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f55a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558359:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f55a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558379:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8feca2cf6700) 00010000:00010000:0.0:1787548759.558381:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548759.558384:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f55a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558389:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f55a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558428:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f54c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24f2 expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558441:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f561 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24f2 expref: 37 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.558449:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec87cebb00) 00010000:00010000:0.0:1787548759.558451:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548759.558453:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150e00, rc 0) 00000100:00100000:0.0:1787548759.558976:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+37:11554:x1874380416175360:12345-192.168.206.13@tcp:101:cat.0 Request processed in 1394us (1707us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787548759.558985:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 197 00000100:00100000:2.0:1787548759.565883:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548759.565963:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416175616 00000100:00100000:1.0:1787548759.565973:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416175616 00000100:00100000:1.0:1787548759.566033:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 54 00000100:00100000:1.0:1787548759.566043:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+37:11554:x1874380416175616:12345-192.168.206.13@tcp:35:cat.0 00000100:00100000:1.0:1787548759.566283:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+38:11554:x1874380416175616:12345-192.168.206.13@tcp:35:cat.0 Request processed in 241us (408us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787548759.566304:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 54 00000100:00100000:1.0:1787548759.594692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548759.594956:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416175872 00000100:00100000:0.0:1787548759.594966:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416175872 00000100:00100000:0.0:1787548759.595027:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 198 00000100:00100000:0.0:1787548759.595038:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+38:11555:x1874380416175872:12345-192.168.206.13@tcp:36:rm.0 00010000:00010000:0.0:1787548759.595095:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787548759.595122:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f561 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24f2 expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.595202:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f537 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24eb expref: 37 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.595214:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f4ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24dd expref: 36 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.595224:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fec87cebb00) 00010000:00010000:0.0:1787548759.595236:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787548759.595259:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f56f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.595269:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f56f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.595277:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f56f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.595289:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f576 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.595295:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f576 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.595300:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f576 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.595592:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f57d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.595600:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f57d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.595613:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f57d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787548759.597397:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787548759.597410:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382474279506ns, next at 383474276911ns, rc = 0 00010000:00010000:0.0:1787548759.597475:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f584 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597490:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597500:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597508:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f584 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597514:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f584 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597520:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f584 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597544:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787548759.597575:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f57d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597582:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f57d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597588:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f57d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597602:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548759.597606:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f57d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597614:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f57d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597627:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6500) 00010000:00010000:0.0:1787548759.597630:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787548759.597634:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f57d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597640:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f57d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597657:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f56f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597663:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f56f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597668:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f56f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597674:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548759.597676:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f56f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597682:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f56f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597699:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:0.0:1787548759.597701:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548759.597705:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f56f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.597711:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f56f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787548759.597721:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013ccd197 reply state 000000006ec6464a transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f576 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.598012:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548759.598019:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f584 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.598025:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150400 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548759.598029:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f584 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.598035:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f584 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.598045:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8feca2cf6500) 00010000:00010000:2.0:1787548759.598047:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787548759.598050:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f584 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.598055:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f584 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.598069:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548759.598071:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548759.598073:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548759.598225:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787548759.598349:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+37:11555:x1874380416175872:12345-192.168.206.13@tcp:36:rm.0 Request processed in 3310us (3662us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787548759.598357:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 198 00010000:00010000:0.0:1787548759.608501:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f576 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.608519:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f576 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.608527:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f576 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.608533:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548759.608539:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f576 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.608546:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f576 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.608596:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8feca2cf6700) 00010000:00010000:0.0:1787548759.608600:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548759.608604:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f576 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.608611:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f576 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548759.668084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548759.668173:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416176128 00000100:00100000:2.0:1787548759.668197:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416176128 00000100:00100000:2.0:1787548759.668244:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 199 00000100:00100000:2.0:1787548759.668254:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+36:11561:x1874380416176128:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:2.0:1787548759.668280:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548759.668301:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f58b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a24f9 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.668424:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f592 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.668440:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f592 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.668451:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f592 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.668471:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f599 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.668478:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f599 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.668485:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f599 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787548759.669009:0:8467:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787548759.669217:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f5a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.669227:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.669245:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.669280:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f592 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.669286:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f592 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.669293:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f592 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.669298:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548759.669302:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f592 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.669308:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f592 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.669319:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:2.0:1787548759.669322:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548759.669326:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f592 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.669331:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f592 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787548759.669344:0:8467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003aaca2c0 reply state 000000006b15fb7a transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f599 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548759.669352:0:8467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787548759.669386:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f58b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24f9 expref: 39 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.669401:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24f9 expref: 38 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.669408:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548759.669411:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548759.669414:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6c00, rc 0) 00000100:00100000:2.0:1787548759.669485:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:11561:x1874380416176128:12345-192.168.206.13@tcp:101:bash.0 Request processed in 1231us (1410us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787548759.669492:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 199 00010000:00010000:2.0:1787548759.674109:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f599 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.674127:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f599 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.674173:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f599 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.674178:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548759.674182:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f599 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.674189:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f599 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.674205:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fec87ceb400) 00010000:00010000:2.0:1787548759.674208:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548759.674226:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f599 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.674232:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f599 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548759.676413:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.676482:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416176256 00000100:00100000:3.0:1787548759.676490:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416176256 00000100:00100000:3.0:1787548759.676542:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 59 00000100:00100000:3.0:1787548759.676555:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416176256:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:3.0:1787548759.676579:0:10297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548759.676596:0:10297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f5ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2500 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787548759.676619:0:10297:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787548759.676634:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:3.0:1787548759.676638:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548759.676646:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f5ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2500 expref: 6 pid: 10297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.676678:0:10297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f5ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2500 expref: 6 pid: 10297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.676689:0:10297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93e00, rc 0) 00000100:00100000:3.0:1787548759.676748:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2351:x1874380416176256:12345-192.168.206.13@tcp:101:bash.0 Request processed in 197us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548759.676755:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 59 00000100:00100000:1.0:1787548759.681545:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548759.682010:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416176384 00000100:00100000:2.0:1787548759.682020:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416176384 00000100:00100000:2.0:1787548759.682078:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 60 00000100:00100000:2.0:1787548759.682089:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcdf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:11561:x1874380416176384:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:2.0:1787548759.682107:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548759.682125:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2507 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.682175:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f5ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2500 expref: 7 pid: 10297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.682184:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548759.682189:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548759.682194:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.682227:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f5ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2500 expref: 7 pid: 10297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.682241:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f5ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2500 expref: 7 pid: 10297 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548759.682276:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad282300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1874380431891968:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548759.682378:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548759.685578:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.685791:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad282300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1874380431891968:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548759.685822:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.685840:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7600, rc 0) 00000100:00100000:3.0:1787548759.685896:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcdf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:11561:x1874380416176384:12345-192.168.206.13@tcp:101:bash.0 Request processed in 3809us (4359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548759.685904:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 60 00000100:00100000:0.0:1787548759.689330:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416176512 00000100:00100000:0.0:1787548759.689344:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416176512 00010000:00010000:0.0:1787548759.689388:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f5ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2500 expref: 7 pid: 10297 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548759.689500:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 76 00000100:00100000:0.0:1787548759.689511:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2352:x1874380416176512:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548759.689528:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548759.689552:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f5ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2500 expref: 7 pid: 10297 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.689580:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f5ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2500 expref: 7 pid: 10297 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.689603:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f5ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2500 expref: 7 pid: 10297 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.689619:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787548759.689635:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787548759.689645:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.689655:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.689694:0:8453:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548759.689708:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad63f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8453:1874380431892096:192.168.206.13@tcp:105: 00000100:00100000:0.0:1787548759.689819:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8a94ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787548759.693538:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad63f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8453:1874380431892096:192.168.206.13@tcp:105: 00010000:00010000:0.0:1787548759.693574:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548759.693636:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2352:x1874380416176512:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 4127us (8077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548759.693646:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 76 00000100:00100000:2.0:1787548759.695236:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.695317:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416176768 00000100:00100000:3.0:1787548759.695325:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416176768 00000100:00100000:3.0:1787548759.695374:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 55 00000100:00100000:3.0:1787548759.695383:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+38:11561:x1874380416176768:12345-192.168.206.13@tcp:35:bash.0 00000100:00100000:3.0:1787548759.695695:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:11561:x1874380416176768:12345-192.168.206.13@tcp:35:bash.0 Request processed in 312us (466us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787548759.695702:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 55 00000100:00100000:2.0:1787548759.921916:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.922000:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416176896 00000100:00100000:3.0:1787548759.922025:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416176896 00000100:00100000:3.0:1787548759.922170:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 200 00000100:00100000:3.0:1787548759.922182:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+39:11577:x1874380416176896:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548759.922207:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548759.922227:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f5bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a250e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.922297:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f5c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.922310:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.922322:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548759.922394:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787548759.922398:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548759.922421:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.922445:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f5bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a250e expref: 41 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.922463:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f5c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a250e expref: 40 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.922472:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:3.0:1787548759.922475:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787548759.922479:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92e00, rc 0) 00000100:00100000:3.0:1787548759.922685:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+40:11577:x1874380416176896:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 504us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548759.922693:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 200 00000100:00100000:3.0:1787548759.933077:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548759.933257:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416177152 00000100:00100000:2.0:1787548759.933269:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416177152 00000100:00100000:2.0:1787548759.933335:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 201 00000100:00100000:2.0:1787548759.933346:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+40:11577:x1874380416177152:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548759.933382:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548759.933403:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f5ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2515 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.933498:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f5d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.933902:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.933915:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548759.933929:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787548759.934064:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f5ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2515 expref: 43 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.934082:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f5d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2515 expref: 42 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.934104:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548759.934107:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548759.934111:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7200, rc 0) 00000100:00100000:2.0:1787548759.934325:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+42:11577:x1874380416177152:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 979us (1255us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787548759.934333:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 201 00000100:00100000:2.0:1787548759.962448:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548759.962498:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.964581:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416177536 00000100:00100000:3.0:1787548759.964595:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416177536 00000100:00100000:3.0:1787548759.964673:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 15 00000100:00100000:3.0:1787548759.964684:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+42:2352:x1874380416177536:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548759.964699:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548759.964724:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f5d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2515 expref: 42 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.964744:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:3.0:1787548759.964749:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548759.964816:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+41:2352:x1874380416177536:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 133us (2377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548759.964823:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 15 00000100:00100000:0.0:1787548759.969242:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416177408 00000100:00100000:0.0:1787548759.969257:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416177408 00000100:00100000:0.0:1787548759.969330:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 202 00000100:00100000:0.0:1787548759.969341:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+41:11577:x1874380416177408:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548759.969366:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548759.969891:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f5df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a251c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.969991:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f5e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.970017:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.970028:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548759.970041:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787548759.970192:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f5df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a251c expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.970226:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f5e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a251c expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548759.970236:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:0.0:1787548759.970239:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787548759.970242:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151400, rc 0) 00000100:00100000:0.0:1787548759.970362:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+43:11577:x1874380416177408:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 1023us (7862us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787548759.970371:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 202 00000100:00100000:2.0:1787548759.984795:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.984921:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416177664 00000100:00100000:3.0:1787548759.984931:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416177664 00000100:00100000:3.0:1787548759.984994:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 61 00000100:00100000:3.0:1787548759.985005:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+6:2354:x1874380416177664:12345-192.168.206.13@tcp:1:lfs.0 00010000:00010000:3.0:1787548759.985044:0:10297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424f5f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.985063:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.985089:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548759.985093:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787548759.985099:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424f5f4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.985349:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.985366:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 6 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548759.985381:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad1ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10297:1874380431892224:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548759.985601:0:10297:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548759.988914:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad1ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10297:1874380431892224:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548759.988946:0:10297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424f5f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548759.989401:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.989722:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416177792 00000100:00100000:3.0:1787548759.989730:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416177792 00002000:00100000:3.0:1787548759.989775:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8feca00a9500 x1874380416177792/t0(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:200/0 lens 504/0 e 0 to 0 dl 1787548770 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787548759.989786:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8feca00a9500 with x1874380416177792 ext(0->8) 00010000:00010000:3.0:1787548759.989793:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 7 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.989807:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 7 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787548759.989815:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8feca00a9500 00000100:00100000:3.0:1787548759.989858:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 3 00000100:00100000:3.0:1787548759.989867:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2351:x1874380416177792:12345-192.168.206.13@tcp:4:lfs.0 00000100:00100000:2.0:1787548759.991598:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2351:x1874380416177792:12345-192.168.206.13@tcp:4:lfs.0 Request processed in 1725us (2190us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787548759.991610:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 3 00002000:00100000:2.0:1787548759.991621:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8feca00a9500 x1874380416177792/t4294967308(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:200/0 lens 504/448 e 0 to 0 dl 1787548770 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787548759.991630:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8feca00a9500 with x1874380416177792 ext(0->8) 00010000:00010000:2.0:1787548759.991639:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 9 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548759.991670:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 9 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787548759.991679:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8feca00a9500 00000100:00100000:1.0:1787548759.999309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548759.999394:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416177920 00000100:00100000:3.0:1787548759.999404:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416177920 00010000:00010000:3.0:1787548759.999443:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 9 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548759.999762:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 77 00000100:00100000:3.0:1787548759.999774:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2352:x1874380416177920:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548759.999789:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787548759.999809:0:5839:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787548759.999812:0:5839:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787548760 00002000:00010000:3.0:1787548759.999814:0:5839:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787548760 00002000:00010000:3.0:1787548759.999817:0:5839:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787548760 00010000:00010000:3.0:1787548759.999822:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 9 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.999838:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 9 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.999859:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d266783/0xcb7c48919424f5b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2507 expref: 9 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548759.999875:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787548759.999880:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787548759.999885:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424f5f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.003211:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424f5f4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.003260:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548760.003334:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2352:x1874380416177920:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 3557us (4030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548760.003344:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 77 00010000:00010000:2.0:1787548760.004168:0:10297:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424f5f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.004182:0:10297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424f5f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.004216:0:10297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424f5f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.004225:0:10297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424f5f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.004233:0:10297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424f5f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.004241:0:10297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93400 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548760.004245:0:10297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424f5f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.004254:0:10297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424f5f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.004291:0:10297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424f5f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.004298:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424f5f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548760.004356:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2354:x1874380416177664:12345-192.168.206.13@tcp:1:lfs.0 Request processed in 19353us (19569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548760.004365:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 61 00000100:00100000:0.0:1787548760.016673:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548760.018552:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416178176 00000100:00100000:3.0:1787548760.018575:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416178176 00000100:00100000:2.0:1787548760.018783:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 56 00000100:00100000:2.0:1787548760.018794:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca6f16c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+43:11577:x1874380416178176:12345-192.168.206.13@tcp:35:lfs.0 00000004:00010000:2.0:1787548760.018859:0:5858:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f5e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a251c expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787548760.019119:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1787548760.019576:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787548760.020313:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787548760.020369:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.020386:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f5a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24f9 expref: 47 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.020395:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.020441:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24f9 expref: 47 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.020590:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f5a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24f9 expref: 47 pid: 8467 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548760.020609:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca00a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5858:1874380431892352:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548760.020766:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548760.033883:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548760.034107:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca00a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5858:1874380431892352:192.168.206.13@tcp:104: 00010000:00010000:1.0:1787548760.034150:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548760.036103:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416178304 00000100:00100000:3.0:1787548760.036116:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416178304 00010000:00010000:2.0:1787548760.037634:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f5a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24f9 expref: 48 pid: 8467 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548760.037686:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 78 00000100:00100000:2.0:1787548760.037705:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+48:2351:x1874380416178304:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548760.037725:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548760.037733:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f5a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24f9 expref: 48 pid: 8467 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.037748:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24f9 expref: 48 pid: 8467 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.037770:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f5a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24f9 expref: 48 pid: 8467 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.037788:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548760.037806:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.037816:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.037823:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.037858:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787548760.037917:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548760.037924:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+47:2351:x1874380416178304:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 230us (4051us total) trans 0 rc 0/0 00010000:00010000:3.0:1787548760.037926:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548760.037932:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 78 00000001:00080000:2.0:1787548760.039298:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787548760.039646:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787548760.040041:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca00abb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431892480:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787548760.040107:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548760.040294:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787548760.040317:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431892480 00000100:00100000:1.0:1787548760.040326:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431892480 00000100:00100000:1.0:1787548760.040399:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787548760.040409:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca00a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5858:x1874380431892480:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1787548760.040555:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548760.040693:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca00a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5858:x1874380431892480:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 285us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548760.040702:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787548760.040845:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca00abb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431892480:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787548760.041892:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787548760.041985:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca00abb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431892608:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787548760.042030:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548760.042062:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787548760.042514:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431892608 00000100:00100000:3.0:1787548760.042525:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431892608 00000100:00100000:3.0:1787548760.042628:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787548760.042639:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec87e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5858:x1874380431892608:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787548760.043006:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec87e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5858:x1874380431892608:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 367us (973us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787548760.043013:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787548760.043097:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca00abb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1874380431892608:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787548760.043327:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1787548760.043366:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.043377:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.043398:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.043404:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548760.043409:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.043417:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.043432:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548760.043435:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787548760.043439:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.043445:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7e00/0xcb7c48919424f5fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787548760.043630:0:5858:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787548760.043799:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787548760.043809:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382920678034ns, next at 383920676088ns, rc = 0 00000001:00080000:2.0:1787548760.043815:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787548760.043917:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548760.043921:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787548760.043928:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f5e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a251c expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548760.044071:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca6f16c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+50:11577:x1874380416178176:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 25278us (27406us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1787548760.044091:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 56 00000020:00080000:2.0:1787548760.044096:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787548760.048445:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548760.049683:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416178432 00000100:00100000:3.0:1787548760.049708:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416178432 00000100:00100000:3.0:1787548760.049903:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 203 00000100:00100000:3.0:1787548760.049915:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+50:11577:x1874380416178432:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548760.049940:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548760.049964:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f602 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2523 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.050023:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f602 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2523 expref: 51 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.050038:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f602 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2523 expref: 51 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.050057:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:3.0:1787548760.050060:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787548760.050064:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92c00, rc 0) 00000100:00100000:2.0:1787548760.050210:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:11577:x1874380416178432:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 296us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548760.050218:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 203 00000100:00100000:1.0:1787548760.057379:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548760.057482:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416178688 00000100:00100000:3.0:1787548760.057492:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416178688 00000100:00100000:3.0:1787548760.057548:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 57 00000100:00100000:3.0:1787548760.057569:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+51:11577:x1874380416178688:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:3.0:1787548760.059170:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+52:11577:x1874380416178688:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 1594us (1780us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1787548760.059182:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 57 00000100:00100000:0.0:1787548760.169012:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548760.169113:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416178816 00000100:00100000:3.0:1787548760.169122:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416178816 00000100:00100000:3.0:1787548760.169198:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 204 00000100:00100000:3.0:1787548760.169208:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+52:11587:x1874380416178816:12345-192.168.206.13@tcp:34:lfs.0 00010000:00010000:3.0:1787548760.169288:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f609 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169304:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f609 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169316:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f609 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169332:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f610 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169339:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169346:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169436:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f617 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169445:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169452:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787548760.169490:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169502:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f609 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169517:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f609 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169524:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f609 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169530:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548760.169534:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f609 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169541:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f609 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169552:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:3.0:1787548760.169555:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548760.169571:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f609 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169578:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f609 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169591:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169597:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f610 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169603:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f610 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169609:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548760.169617:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f610 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169624:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f610 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169632:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fec90d93800) 00010000:00010000:3.0:1787548760.169635:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548760.169638:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f610 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169644:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f610 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169658:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169665:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f617 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169671:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f617 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169677:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548760.169680:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f617 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169686:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f617 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169692:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:3.0:1787548760.169694:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548760.169702:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f617 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.169708:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f617 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548760.169781:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+52:11587:x1874380416178816:12345-192.168.206.13@tcp:34:lfs.0 Request processed in 573us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548760.169789:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 204 00000100:00100000:2.0:1787548760.231020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.231108:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416179072 00000100:00100000:0.0:1787548760.231118:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416179072 00000100:00100000:0.0:1787548760.231208:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 205 00000100:00100000:0.0:1787548760.231218:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+52:11590:x1874380416179072:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548760.231237:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548760.231255:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f61e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a252a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231337:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f625 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231351:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231361:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231378:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f62c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231385:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f62c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231392:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f62c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231509:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f633 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231517:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231523:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548760.231532:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787548760.231631:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231639:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f625 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231654:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231660:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548760.231664:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231672:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f625 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231683:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:0.0:1787548760.231686:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548760.231690:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f625 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231695:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f625 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231707:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f62c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231713:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f62c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231718:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f62c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231723:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548760.231726:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f62c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231741:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f62c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231749:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8feca2cf6700) 00010000:00010000:0.0:1787548760.231751:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548760.231754:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f62c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231760:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f62c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231795:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f61e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a252a expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231806:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a252a expref: 54 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.231812:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:0.0:1787548760.231814:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548760.231817:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150c00, rc 0) 00000100:00100000:0.0:1787548760.231876:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:11590:x1874380416179072:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 659us (865us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1787548760.231883:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 205 00000100:00100000:1.0:1787548760.234960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548760.235109:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416179200 00000100:00100000:3.0:1787548760.235118:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416179200 00000100:00100000:3.0:1787548760.235195:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 206 00000100:00100000:3.0:1787548760.235205:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:11590:x1874380416179200:12345-192.168.206.13@tcp:54:lfs.0 00010000:00010000:3.0:1787548760.235266:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f641 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.235281:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.235293:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.235316:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.235324:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f641 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.235330:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f641 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.235335:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548760.235354:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f641 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.235361:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f641 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.235719:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:3.0:1787548760.235723:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787548760.235728:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f641 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.235735:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f641 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548760.235815:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:11590:x1874380416179200:12345-192.168.206.13@tcp:54:lfs.0 Request processed in 610us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548760.235823:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 206 00000100:00100000:3.0:1787548760.237524:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548760.237709:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416179456 00000100:00100000:2.0:1787548760.237729:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416179456 00000100:00100000:2.0:1787548760.237778:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 58 00000100:00100000:2.0:1787548760.237787:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+54:11590:x1874380416179456:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:2.0:1787548760.238048:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:11590:x1874380416179456:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 261us (529us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787548760.238055:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 58 00000100:00100000:2.0:1787548760.359188:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.359228:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416179712 00000100:00100000:0.0:1787548760.359239:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416179712 00000100:00100000:0.0:1787548760.359299:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 207 00000100:00100000:0.0:1787548760.359310:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+55:11600:x1874380416179712:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:0.0:1787548760.359351:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548760.359354:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787548760.359382:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f5c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a250e expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.359399:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:0.0:1787548760.359404:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787548760.359417:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f648 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2531 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.359512:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f64f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.359525:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f64f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.359534:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f64f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548760.359544:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787548760.359657:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f648 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2531 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.359670:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f64f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2531 expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.359678:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:0.0:1787548760.359680:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548760.359683:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150200, rc 0) 00000100:00100000:0.0:1787548760.359746:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:11600:x1874380416179712:12345-192.168.206.13@tcp:101:bash.0 Request processed in 438us (616us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787548760.359753:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 207 00000100:00100000:1.0:1787548760.364236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.364290:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416179968 00000100:00100000:0.0:1787548760.364299:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416179968 00000100:00100000:0.0:1787548760.364357:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 208 00000100:00100000:0.0:1787548760.364368:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:11600:x1874380416179968:12345-192.168.206.13@tcp:36:bash.0 00010000:00010000:0.0:1787548760.364420:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787548760.364445:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f64f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2531 expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.364479:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f633 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a252a expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.364489:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:0.0:1787548760.364493:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787548760.364694:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f65d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.364718:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f65d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.364728:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f65d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787548760.364799:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1787548760.364825:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089be1a3c reply state 000000006221a959 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f65d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548760.364843:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787548760.364928:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:11600:x1874380416179968:12345-192.168.206.13@tcp:36:bash.0 Request processed in 562us (702us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787548760.364934:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 208 00000020:00080000:0.0:1787548760.364939:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787548760.367551:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f65d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.367576:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f65d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.367583:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f65d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.367588:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548760.367593:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f65d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.367600:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f65d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.367616:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:0.0:1787548760.367619:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548760.367623:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f65d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.367629:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f65d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548760.368525:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.368607:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416180096 00000100:00100000:0.0:1787548760.368625:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416180096 00000100:00100000:0.0:1787548760.368680:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 209 00000100:00100000:0.0:1787548760.368690:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+56:11600:x1874380416180096:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:0.0:1787548760.368719:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548760.368735:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f664 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2538 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.368808:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f66b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.368820:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f66b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.368830:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f66b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548760.368853:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787548760.368856:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548760.368874:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f66b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.368899:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f664 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2538 expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.368914:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f66b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2538 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.368922:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:0.0:1787548760.368925:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548760.368928:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151400, rc 0) 00000100:00100000:0.0:1787548760.368993:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:11600:x1874380416180096:12345-192.168.206.13@tcp:101:bash.0 Request processed in 304us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548760.369000:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 209 00000100:00100000:3.0:1787548760.373493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548760.373601:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416180352 00000100:00100000:2.0:1787548760.373611:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416180352 00000100:00100000:2.0:1787548760.373665:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 59 00000100:00100000:2.0:1787548760.373675:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+57:11600:x1874380416180352:12345-192.168.206.13@tcp:35:bash.0 00000100:00100000:2.0:1787548760.373904:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+58:11600:x1874380416180352:12345-192.168.206.13@tcp:35:bash.0 Request processed in 229us (419us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787548760.373912:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 59 00000100:00100000:3.0:1787548760.461193:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.461352:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416180480 00000100:00100000:0.0:1787548760.461364:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416180480 00000100:00100000:0.0:1787548760.461423:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 210 00000100:00100000:0.0:1787548760.461434:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+58:11606:x1874380416180480:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548760.461459:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548760.461477:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f672 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a253f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.461537:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f679 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.461551:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.461573:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548760.461628:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787548760.461631:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548760.461651:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.461673:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a253f expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.461691:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a253f expref: 59 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.461730:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:0.0:1787548760.461733:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787548760.461737:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150000, rc 0) 00000100:00100000:0.0:1787548760.461801:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+59:11606:x1874380416180480:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 368us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548760.461808:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 210 00000100:00100000:2.0:1787548760.469469:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.469595:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416180608 00000100:00100000:0.0:1787548760.469606:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416180608 00000100:00100000:0.0:1787548760.469669:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 211 00000100:00100000:0.0:1787548760.469680:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+59:11606:x1874380416180608:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548760.469699:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548760.469730:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f680 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2546 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.469812:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f687 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.469826:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f687 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.469837:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f687 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.469850:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f68e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.469856:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f68e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.469874:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f68e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.469965:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f695 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.469974:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.469981:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548760.470012:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787548760.470016:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548760.470033:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470044:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470052:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f687 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470058:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f687 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470064:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f687 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470069:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548760.470073:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f687 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470087:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f687 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470098:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:0.0:1787548760.470102:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548760.470106:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f687 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470112:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f687 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470125:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f68e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470175:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f68e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470182:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f68e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470187:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548760.470190:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f68e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470196:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f68e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470203:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8feca2cf6700) 00010000:00010000:0.0:1787548760.470206:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548760.470209:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f68e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470225:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f68e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470255:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f680 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2546 expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470267:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f695 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2546 expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.470274:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:0.0:1787548760.470277:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548760.470279:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150400, rc 0) 00000100:00100000:0.0:1787548760.470329:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:11606:x1874380416180608:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 651us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548760.470336:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 211 00000100:00100000:1.0:1787548760.475478:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.475637:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416180864 00000100:00100000:0.0:1787548760.475648:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416180864 00000100:00100000:0.0:1787548760.475706:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 212 00000100:00100000:0.0:1787548760.475726:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:11606:x1874380416180864:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548760.475744:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548760.475762:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f69c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a254d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.475853:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.475868:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f66b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2538 expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.475890:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f695 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2546 expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.475899:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.475931:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f695 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2546 expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.475945:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f695 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2546 expref: 61 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548760.475959:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad63f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1874380431892736:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548760.476054:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f66b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2538 expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.476064:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f66b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2538 expref: 61 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548760.476072:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad63e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1874380431892864:192.168.206.13@tcp:104: 00000100:00100000:0.0:1787548760.477190:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecbca32540 going to sleep for 11 seconds 00000100:00100000:2.0:1787548760.484690:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.485098:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416180992 00000100:00100000:0.0:1787548760.485107:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416180992 00010000:00010000:0.0:1787548760.485179:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f695 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2546 expref: 62 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548760.485240:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 79 00000100:00100000:0.0:1787548760.485250:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+62:2351:x1874380416180992:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548760.485265:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548760.485272:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f695 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2546 expref: 62 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.485285:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f695 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2546 expref: 62 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.485307:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:0.0:1787548760.485312:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.485321:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.485327:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548760.485368:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+62:2351:x1874380416180992:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 120us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548760.485376:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 79 00010000:00010000:3.0:1787548760.488585:0:5856:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.13@tcp) returned -22 from blocking AST (req@00000000e01be4ab x1874380431892736) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f695 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2546 expref: 61 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.488611:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150400/0xcb7c48919424f695 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2546 expref: 61 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548760.488629:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad63f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1874380431892736:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548760.493538:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad63e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1874380431892864:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548760.493593:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:3.0:1787548760.493600:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.493611:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.493620:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548760.501672:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.501784:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416181120 00000100:00100000:0.0:1787548760.501794:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416181120 00010000:00010000:0.0:1787548760.501832:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f66b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2538 expref: 61 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548760.501884:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 80 00000100:00100000:0.0:1787548760.501895:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:2352:x1874380416181120:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548760.501916:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548760.501923:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f66b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2538 expref: 61 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.501936:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f66b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2538 expref: 61 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.501957:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f66b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2538 expref: 61 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.501972:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:0.0:1787548760.501977:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.501986:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.501993:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.502026:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548760.502084:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:2352:x1874380416181120:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 191us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548760.502092:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 80 00010000:00010000:3.0:1787548760.502257:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.502266:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548760.502289:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787548760.502426:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424f69c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a254d expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.502441:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a254d expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.502449:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:3.0:1787548760.502452:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787548760.502454:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150800, rc 0) 00000100:00100000:3.0:1787548760.502533:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:11606:x1874380416180864:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 26811us (27064us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787548760.502542:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 212 00000100:00100000:2.0:1787548760.509380:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.509466:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416181376 00000100:00100000:0.0:1787548760.509475:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416181376 00000100:00100000:0.0:1787548760.509535:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:0.0:1787548760.509545:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:11606:x1874380416181376:12345-192.168.206.13@tcp:103:lfs.0 00010000:00010000:0.0:1787548760.509589:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548760.509613:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f602 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2523 expref: 60 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.509631:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:0.0:1787548760.509637:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548760.509696:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+59:11606:x1874380416181376:12345-192.168.206.13@tcp:103:lfs.0 Request processed in 151us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548760.509703:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:2.0:1787548760.511856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.511929:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416181504 00000100:00100000:0.0:1787548760.511937:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416181504 00000100:00100000:0.0:1787548760.511989:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 213 00000100:00100000:0.0:1787548760.511999:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+59:11606:x1874380416181504:12345-192.168.206.13@tcp:58:lfs.0 00010000:00010000:0.0:1787548760.512090:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f6b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.512105:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f6b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.512116:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f6b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787548760.512329:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787548760.512407:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+59:11606:x1874380416181504:12345-192.168.206.13@tcp:58:lfs.0 Request processed in 409us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548760.512415:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 213 00010000:00010000:1.0:1787548760.516601:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548760.517406:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548760.517835:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416181632 00000100:00100000:3.0:1787548760.517859:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416181632 00000100:00100000:3.0:1787548760.517924:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 214 00000100:00100000:3.0:1787548760.517935:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+59:11606:x1874380416181632:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:3.0:1787548760.517955:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548760.517974:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f6b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2554 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.518027:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f6b1 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.518036:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f6b8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2554 expref: 60 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.518054:0:5855:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f6b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.518066:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f6b8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2554 expref: 60 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.518078:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:3.0:1787548760.518081:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787548760.518084:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f6b8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2554 expref: 60 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.518091:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93400, rc 0) 00000100:00100000:3.0:1787548760.518178:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:11606:x1874380416181632:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 245us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548760.518185:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 214 00000100:00100000:3.0:1787548760.580401:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787548760.580426:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad61ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431892992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548760.580495:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548760.580584:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad63c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431893120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548760.580592:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431892992 00000100:00100000:3.0:1787548760.580599:0:11969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431892992 00000100:00100000:2.0:1787548760.580614:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548760.580636:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431893120 00000100:00100000:3.0:1787548760.580639:0:11969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431893120 00000100:00100000:2.0:1787548760.580650:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787548760.580659:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1874380431892992:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548760.580660:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787548760.580665:0:11969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874380431893120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787548760.580679:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00002000:00000024:3.0:1787548760.580689:0:11969:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548760.580965:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8829a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874380431893504:0@lo:400:kworker.0 00000100:00100000:0.0:1787548760.585171:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad63e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431893248:0@lo:400:kworker.0 00000100:00100000:2.0:1787548760.585632:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1874380431892992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4971us (5133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548760.585644:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1787548760.585689:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787548760.585708:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad63f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431893376:0@lo:400:kworker.0 00000100:00100000:2.0:1787548760.585758:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548760.585821:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad61ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431892992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787548760.585867:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431893376 00000100:00100000:2.0:1787548760.585873:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431893376 00000100:00100000:2.0:1787548760.585912:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787548760.585920:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431893376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548760.585968:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431893376:12345-0@lo:400:kworker.0 Request processed in 48us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548760.585974:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787548760.585998:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad63f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431893376:0@lo:400:kworker.0 00000100:00100000:3.0:1787548760.592564:0:11969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874380431893120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11745us (11796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548760.592579:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787548760.592681:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb515d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431893632:0@lo:400:kworker.0 00000100:00100000:1.0:1787548760.596528:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548760.596768:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431893504 00000100:00100000:3.0:1787548760.596778:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431893504 00000100:00100000:3.0:1787548760.596839:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787548760.596850:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874380431893504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548760.596907:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874380431893504:12345-0@lo:400:kworker.0 Request processed in 61us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548760.596914:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1787548760.597164:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787548760.597198:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8829a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874380431893504:0@lo:400:kworker.0 00000100:00100000:2.0:1787548760.598230:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548760.598311:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad63c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431893120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548760.598569:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431893632 00000100:00100000:3.0:1787548760.598576:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431893632 00000100:00100000:3.0:1787548760.598637:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787548760.598646:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431893632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548760.598693:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431893632:12345-0@lo:400:kworker.0 Request processed in 49us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548760.598715:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787548760.598799:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb515d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431893632:0@lo:400:kworker.0 00000100:00080000:1.0:1787548760.598878:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548760.601205:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548760.601386:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431893248 00000100:00100000:3.0:1787548760.601395:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431893248 00000100:00100000:3.0:1787548760.601446:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787548760.601467:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3314:x1874380431893248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548760.601531:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3314:x1874380431893248:12345-0@lo:400:kworker.0 Request processed in 66us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548760.601538:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787548760.603460:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad63e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431893248:0@lo:400:kworker.0 00000040:00080000:0.0:1787548760.771995:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787548760.772005:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787548760.772061:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787548760.772068:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787548760.772202:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb515d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874380431893760:192.168.206.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787548760.772301:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecbca32300 going to sleep for 11 seconds 00000100:00100000:1.0:1787548760.781504:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548760.781668:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416181760 00000100:00100000:3.0:1787548760.781677:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416181760 00000100:00100000:3.0:1787548760.781741:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 215 00000100:00100000:3.0:1787548760.781751:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:11607:x1874380416181760:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787548760.781781:0:5855:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787548760.781879:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:11607:x1874380416181760:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 Request processed in 129us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548760.781887:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 215 00000100:00100000:0.0:1787548760.784064:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb515d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874380431893760:192.168.206.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787548760.785824:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548760.786930:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416181888 00000100:00100000:2.0:1787548760.786945:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416181888 00000100:00100000:2.0:1787548760.787012:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 216 00000100:00100000:2.0:1787548760.787023:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:11607:x1874380416181888:12345-192.168.206.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787548760.787102:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f6bf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787119:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f6bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787147:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f6bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787165:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f6c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787172:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787179:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787201:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f6cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787210:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f6cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787216:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f6cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548760.787255:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787548760.787273:0:8467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548760.787286:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f6cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787297:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f6bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787303:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f6bf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787311:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f6bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787317:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548760.787321:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f6bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787328:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f6bf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787339:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8feca2d51a00) 00010000:00010000:2.0:1787548760.787342:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548760.787346:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f6bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787351:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f6bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787364:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787369:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f6c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787383:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787388:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548760.787426:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787434:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f6c6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787443:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8fec87cebf00) 00010000:00010000:2.0:1787548760.787445:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548760.787448:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f6c6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787455:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f6c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787470:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f6cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787476:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f6cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787481:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f6cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787486:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548760.787488:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f6cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787504:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f6cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787512:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:2.0:1787548760.787514:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548760.787517:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f6cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.787522:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f6cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548760.787664:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:11607:x1874380416181888:12345-192.168.206.13@tcp:34:lhsmtool_posix.0 Request processed in 642us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548760.787682:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 216 00000100:00100000:2.0:1787548760.790593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548760.790692:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416182144 00000100:00100000:3.0:1787548760.790701:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416182144 00000100:00100000:3.0:1787548760.790870:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 217 00000100:00100000:3.0:1787548760.790880:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+60:11607:x1874380416182144:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787548760.790902:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548760.790922:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f6d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a255b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.791016:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f6db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.791045:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f6db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.791057:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f6db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548760.791070:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787548760.791363:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f6db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.791371:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f6db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.791378:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f6db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.791384:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548760.791388:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f6db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.791395:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f6db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.791407:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:3.0:1787548760.791410:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787548760.791414:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f6db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.791419:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f6db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.791530:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f6d4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a255b expref: 62 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.791549:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8feca2d51a00) 00010000:00010000:3.0:1787548760.791551:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787548760.791568:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f6d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a255b expref: 62 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.791578:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92a00, rc 0) 00000100:00100000:3.0:1787548760.791678:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:11607:x1874380416182144:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 799us (1093us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787548760.791687:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 217 00000100:00100000:1.0:1787548760.794658:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.794816:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416182272 00000100:00100000:0.0:1787548760.794825:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416182272 00000100:00100000:0.0:1787548760.794936:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 218 00000100:00100000:0.0:1787548760.794949:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:11607:x1874380416182272:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787548760.794986:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787548760.795092:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:11607:x1874380416182272:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 Request processed in 146us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548760.795099:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 218 00000100:00100000:2.0:1787548760.800288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548760.800417:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416182528 00000100:00100000:1.0:1787548760.800427:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416182528 00000100:00100000:1.0:1787548760.800483:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 219 00000100:00100000:1.0:1787548760.800493:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:11607:x1874380416182528:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787548760.800512:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548760.800516:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787548760.800542:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f679 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a253f expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548760.800570:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:1.0:1787548760.800574:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787548760.800587:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f6e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2562 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787548760.801013:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1787548760.801254:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f6f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548760.801269:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548760.801279:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548760.801348:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22ec00/0xcb7c48919424f6e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2562 expref: 63 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548760.801364:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2562 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548760.801372:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8feca2d51700) 00010000:00010000:1.0:1787548760.801374:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787548760.801377:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22f000, rc 0) 00000100:00100000:1.0:1787548760.801443:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+62:11607:x1874380416182528:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 951us (1164us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787548760.801451:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 219 00000100:00100000:2.0:1787548760.807383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548760.807542:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416182784 00000100:00100000:3.0:1787548760.807553:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416182784 00000100:00100000:3.0:1787548760.807658:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 220 00000100:00100000:3.0:1787548760.807669:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+62:11607:x1874380416182784:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787548760.807752:0:8467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548760.807780:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f000/0xcb7c48919424f6f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2562 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.807805:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8feca2d51700) 00010000:00010000:3.0:1787548760.807815:0:8467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787548760.807838:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f6fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.807852:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f6fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.807862:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f6fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.807897:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f705 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x28bca151 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.807905:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x28bca151 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.807911:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x28bca151 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.807993:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f6fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.808001:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f6fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.808008:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f6fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.808014:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92a00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548760.808019:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f6fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.808027:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f6fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.808036:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:3.0:1787548760.808039:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548760.808043:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f6fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.808048:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f6fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.808065:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x28bca151 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.808071:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f705 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x28bca151 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.808076:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f705 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x28bca151 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.808081:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548760.808084:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f705 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x28bca151 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.808090:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f705 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x28bca151 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.808098:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x28bca151 (ffff8fec90d93800) 00010000:00010000:3.0:1787548760.808100:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548760.808103:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f705 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x28bca151 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.808108:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f705 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x28bca151 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548760.808276:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:11607:x1874380416182784:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 608us (902us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787548760.808284:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 220 00000100:00100000:2.0:1787548760.813304:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548760.813349:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416182912 00000100:00100000:3.0:1787548760.813358:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416182912 00000100:00100000:3.0:1787548760.813446:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 221 00000100:00100000:3.0:1787548760.813472:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+61:11607:x1874380416182912:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787548760.813490:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548760.813514:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f70c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2569 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.813569:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f713 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.813582:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.813599:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.813692:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f70c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2569 expref: 63 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.813818:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f713 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2569 expref: 62 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.813831:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fec90d93900) 00010000:00010000:3.0:1787548760.813834:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787548760.813837:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92c00, rc 0) 00000100:00100000:3.0:1787548760.814359:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+62:11607:x1874380416182912:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 887us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548760.814368:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 221 00000100:00100000:2.0:1787548760.818007:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.818345:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416183168 00000100:00100000:0.0:1787548760.818355:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416183168 00000100:00100000:0.0:1787548760.818582:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 222 00000100:00100000:0.0:1787548760.818593:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+62:11607:x1874380416183168:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787548760.818672:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f71a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.818688:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f71a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.818699:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f71a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787548760.818959:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1787548760.818970:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383695838772ns, next at 384695836069ns, rc = 0 00000004:00010000:0.0:1787548760.819053:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc6e3b8a reply state 00000000266e3322 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f71a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548760.819062:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787548760.819177:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+64:11607:x1874380416183168:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 585us (1182us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787548760.819185:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 222 00010000:00010000:3.0:1787548760.823517:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f71a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.823570:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f71a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.823578:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f71a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.823583:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548760.823587:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f71a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.823595:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f71a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.823610:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fec90d93900) 00010000:00010000:3.0:1787548760.823613:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787548760.823617:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f71a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.823623:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150c00/0xcb7c48919424f71a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548760.824431:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548760.824480:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416183296 00000100:00100000:3.0:1787548760.824490:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416183296 00000100:00100000:3.0:1787548760.824537:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 223 00000100:00100000:3.0:1787548760.824562:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+63:11607:x1874380416183296:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787548760.824586:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548760.824603:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f721 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2570 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.824673:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f721 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2570 expref: 64 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.824686:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f721 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2570 expref: 64 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.824704:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fec90d93900) 00010000:00010000:3.0:1787548760.824913:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787548760.824918:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92800, rc 0) 00000100:00100000:3.0:1787548760.824979:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+64:11607:x1874380416183296:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 433us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548760.824987:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 223 00000100:00100000:2.0:1787548760.831506:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548760.831596:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416183424 00000100:00100000:3.0:1787548760.831607:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416183424 00000100:00100000:3.0:1787548760.831683:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 62 00000100:00100000:3.0:1787548760.831693:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2352:x1874380416183424:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787548760.831981:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:2352:x1874380416183424:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 Request processed in 288us (484us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787548760.831989:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 62 00000100:00080000:1.0:1787548760.834523:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787548760.839365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548760.839467:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416183680 00000100:00100000:2.0:1787548760.839477:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416183680 00000100:00100000:2.0:1787548760.839531:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 60 00000100:00100000:2.0:1787548760.839542:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb515d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+64:11607:x1874380416183680:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787548760.839795:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb515d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+65:11607:x1874380416183680:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 Request processed in 253us (439us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787548760.839803:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 60 00000100:00100000:3.0:1787548760.843325:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548760.843536:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416183936 00000100:00100000:2.0:1787548760.843547:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416183936 00000100:00100000:2.0:1787548760.843615:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 224 00000100:00100000:2.0:1787548760.843625:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+65:11607:x1874380416183936:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787548760.843751:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+65:11607:x1874380416183936:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 127us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548760.843758:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 224 00000100:00100000:1.0:1787548760.848413:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548760.848509:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416184064 00000100:00100000:3.0:1787548760.848522:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416184064 00000100:00100000:3.0:1787548760.848598:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 225 00000100:00100000:3.0:1787548760.848609:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+65:11607:x1874380416184064:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787548760.848628:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548760.848663:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f728 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2577 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.848744:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f72f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.848758:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f72f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.848770:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f72f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548760.848805:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548760.848821:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f72f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.848846:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93e00/0xcb7c48919424f728 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2577 expref: 67 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.848863:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f72f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2577 expref: 66 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.848871:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fec90d93900) 00010000:00010000:3.0:1787548760.848874:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787548760.848877:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92a00, rc 0) 00000100:00100000:3.0:1787548760.848940:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+66:11607:x1874380416184064:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 332us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548760.848946:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 225 00000100:00100000:3.0:1787548760.853123:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548760.853293:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416184192 00000100:00100000:1.0:1787548760.853303:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416184192 00000100:00100000:1.0:1787548760.853359:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 63 00000100:00100000:1.0:1787548760.853370:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad1fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+10:2352:x1874380416184192:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787548760.853388:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548760.853408:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424f736 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a257e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787548760.853433:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8bd459, blocks: 0x1 00010000:00010000:1.0:1787548760.853452:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787548760.853457:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548760.853466:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424f736 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a257e expref: 11 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548760.853495:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424f736 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a257e expref: 11 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548760.853507:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22ea00, rc 0) 00000100:00100000:1.0:1787548760.853578:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad1fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+11:2352:x1874380416184192:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 211us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548760.853585:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 63 00000100:00100000:1.0:1787548760.856775:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548760.856909:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416184448 00000100:00100000:2.0:1787548760.856919:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416184448 00000100:00100000:2.0:1787548760.857016:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 226 00000100:00100000:2.0:1787548760.857027:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+66:11607:x1874380416184448:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787548760.857157:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+66:11607:x1874380416184448:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 132us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548760.857165:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 226 00000100:00100000:3.0:1787548760.859910:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548760.860006:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416184576 00000100:00100000:2.0:1787548760.860017:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416184576 00000100:00100000:2.0:1787548760.860105:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 64 00000100:00100000:2.0:1787548760.860115:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+11:11607:x1874380416184576:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787548760.860173:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548760.860192:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5982e27/0xcb7c48919424f73d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2585 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.860221:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424f736 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a257e expref: 12 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.860230:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548760.860242:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548760.860248:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5982e27/0xcb7c48919424f73d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2585 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.860282:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424f736 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a257e expref: 12 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.860295:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424f736 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a257e expref: 12 pid: 6692 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548760.860309:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad61ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1874380431893888:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548760.860401:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787548760.863343:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.863578:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416184704 00000100:00100000:0.0:1787548760.863587:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416184704 00010000:00010000:0.0:1787548760.863626:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424f736 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a257e expref: 13 pid: 6692 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548760.863669:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 81 00000100:00100000:0.0:1787548760.863680:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:2352:x1874380416184704:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548760.863693:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548760.863935:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424f736 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a257e expref: 13 pid: 6692 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.863951:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424f736 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a257e expref: 13 pid: 6692 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.863976:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787548760.863994:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787548760.864004:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5982e27/0xcb7c48919424f73d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2585 expref: 13 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.864016:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5982e27/0xcb7c48919424f73d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2585 expref: 13 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.864055:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c5982e27/0xcb7c48919424f73d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2585 expref: 13 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548760.864070:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca00a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5840:1874380431894016:192.168.206.13@tcp:105: 00000100:00100000:0.0:1787548760.864169:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecbca32d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787548760.867188:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca00a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5840:1874380431894016:192.168.206.13@tcp:105: 00010000:00010000:0.0:1787548760.867232:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548760.867283:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:2352:x1874380416184704:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 3604us (3947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548760.867295:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 81 00010000:00010000:2.0:1787548760.867794:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424f736 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a257e expref: 12 pid: 6692 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548760.867812:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad61ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1874380431893888:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548760.867834:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5982e27/0xcb7c48919424f73d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2585 expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.867848:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6000, rc 0) 00000100:00100000:2.0:1787548760.867882:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+11:11607:x1874380416184576:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 7768us (7980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548760.867889:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 64 00000100:00100000:3.0:1787548760.871907:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548760.872192:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416184832 00000100:00100000:2.0:1787548760.872201:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416184832 00002000:00100000:2.0:1787548760.872250:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8feb81a85500 x1874380416184832/t0(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:201/0 lens 504/0 e 0 to 0 dl 1787548771 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787548760.872275:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8feb81a85500 with x1874380416184832 ext(0->12) 00002000:00010000:2.0:1787548760.872281:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8feb81a85500 00000100:00100000:2.0:1787548760.872365:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 6 00000100:00100000:2.0:1787548760.872375:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+11:2353:x1874380416184832:12345-192.168.206.13@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787548760.872846:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:2353:x1874380416184832:12345-192.168.206.13@tcp:4:lhsmtool_posix.0 Request processed in 471us (946us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787548760.872854:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 6 00002000:00100000:2.0:1787548760.872862:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8feb81a85500 x1874380416184832/t4294967320(0) o4->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:201/0 lens 504/448 e 0 to 0 dl 1787548771 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787548760.872869:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8feb81a85500 with x1874380416184832 ext(0->12) 00002000:00010000:2.0:1787548760.872873:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8feb81a85500 00000100:00100000:3.0:1787548760.876028:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548760.876115:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416184960 00000100:00100000:1.0:1787548760.876125:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416184960 00000100:00100000:1.0:1787548760.876198:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 227 00000100:00100000:1.0:1787548760.876208:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+66:11607:x1874380416184960:12345-192.168.206.13@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787548760.927018:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1787548760.927035:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:3.0:1787548760.927105:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:0.0:1787548760.927288:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787548760.927308:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca2f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431894272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787548760.927373:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548760.927460:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431894272 00000100:00100000:0.0:1787548760.927467:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431894272 00000100:00100000:0.0:1787548760.927508:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787548760.927517:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca2f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1874380431894272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787548760.927674:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787548760.927678:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787548761 00002000:00010000:0.0:1787548760.927695:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787548760.927696:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787548761 -> 1787548761 00002000:00010000:0.0:1787548760.927699:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787548760.927753:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca2f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1874380431894272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 236us (380us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787548760.927760:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:0.0:1787548760.927799:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8feca2f3f800/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787548760.927805:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca2f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431894272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787548760.928280:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feca00a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431894144:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787548760.928316:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548760.928622:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431894144 00000100:00100000:2.0:1787548760.928628:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431894144 00000100:00100000:2.0:1787548760.928673:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787548760.928682:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1874380431894144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787548760.928829:0:10297:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1787548760.928854:0:10297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5c44bb6/0xcb7c48919424f744 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.928876:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f506 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24e4 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.928886:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787548760.928891:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787548760.928996:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5c44bb6/0xcb7c48919424f744 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.929031:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24e4 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.929045:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f506 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24e4 expref: 12 pid: 6690 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548760.929058:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad61ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10297:1874380431894400:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548760.929121:0:10297:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548760.929243:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+59:11607:x1874380416184960:12345-192.168.206.13@tcp:44:lhsmtool_posix.0 Request processed in 53036us (53222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548760.929252:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 227 00000020:00080000:3.0:1787548760.930050:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1787548760.930076:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fec88381a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787548760.930080:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8feca7696c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fec88381180 00000020:00080000:3.0:1787548760.930084:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8feca7696b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fecaf3fa000 00000001:00080000:3.0:1787548760.930098:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1787548760.930106:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1787548760.930117:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8feb826ece40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787548760.930119:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fec8561a800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8feb826ecd80 00000020:00080000:3.0:1787548760.930122:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fec8561a700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fecad1f3800 00000020:00080000:3.0:1787548760.931237:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787548760.932115:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787548760.932302:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431894528:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787548760.932363:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548760.932594:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431894528 00000100:00100000:3.0:1787548760.932601:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431894528 00000100:00100000:3.0:1787548760.933065:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787548760.933076:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1874380431894528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787548760.933102:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1787548760.933161:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8bd458, atime: 0x6a8bd458, ctime: 0x6a8bd458, blocks: 0x1 00010000:00010000:3.0:1787548760.933169:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f74b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.933185:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1787548760.933202:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548760.933209:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f74b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.933225:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f74b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.933235:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f74b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.933243:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f74b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548760.933258:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787548760.934230:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3316:x1874380431894528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1152us (1863us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787548760.934240:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1787548760.934387:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548760.934395:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f74b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.934405:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93e00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548760.934419:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f74b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.934429:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f74b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.934446:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f74b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.934461:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f828d2b8/0xcb7c48919424f74b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.934481:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548760.934483:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548760.934485:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548760.935359:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548760.935405:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad61ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10297:1874380431894400:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548760.935439:0:10297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5c44bb6/0xcb7c48919424f744 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548760.936437:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416185088 00000100:00100000:0.0:1787548760.936448:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416185088 00010000:00010000:0.0:1787548760.936496:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f506 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24e4 expref: 13 pid: 6690 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548760.936534:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 82 00000100:00100000:0.0:1787548760.936544:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+13:2351:x1874380416185088:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787548760.936570:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548760.936576:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f506 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24e4 expref: 13 pid: 6690 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.936590:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24e4 expref: 13 pid: 6690 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.936613:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4b2b988/0xcb7c48919424f506 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24e4 expref: 13 pid: 6690 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.936646:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787548760.936650:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787548760.936656:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5c44bb6/0xcb7c48919424f744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.936666:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5c44bb6/0xcb7c48919424f744 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.936690:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548760.936758:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:2351:x1874380416185088:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 214us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548760.936765:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 82 00010000:00010000:1.0:1787548760.937647:0:10297:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5c44bb6/0xcb7c48919424f744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548760.937660:0:10297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5c44bb6/0xcb7c48919424f744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548760.937670:0:10297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5c44bb6/0xcb7c48919424f744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548760.937676:0:10297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5c44bb6/0xcb7c48919424f744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548760.937755:0:10297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787548760.938491:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3314:x1874380431894144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9807us (10169us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787548760.938500:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1787548760.938752:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8feca00a8380/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787548760.938759:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feca00a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431894144:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787548760.940046:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000004:00080000:3.0:1787548760.940167:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fecbd0c9c00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787548760.940175:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431894528:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787548760.941077:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548760.941088:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5c44bb6/0xcb7c48919424f744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.941100:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6c00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548760.941105:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5c44bb6/0xcb7c48919424f744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.941115:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5c44bb6/0xcb7c48919424f744 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.941152:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5c44bb6/0xcb7c48919424f744 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.941179:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5c44bb6/0xcb7c48919424f744 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548760.941203:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548760.941205:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548760.941207:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548760.941575:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416185216 00000100:00100000:1.0:1787548760.941584:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416185216 00000100:00100000:1.0:1787548760.941664:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 68 00000100:00100000:1.0:1787548760.941675:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:2351:x1874380416185216:12345-192.168.206.13@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787548760.982495:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+12:2351:x1874380416185216:12345-192.168.206.13@tcp:16:lhsmtool_posix.0 Request processed in 40811us (42444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548760.982510:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 68 00000001:00080000:0.0:1787548760.984589:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1787548760.984612:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1787548760.984622:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1787548760.984629:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1787548760.987233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.987335:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416185472 00000100:00100000:0.0:1787548760.987344:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416185472 00000100:00100000:0.0:1787548760.987403:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 228 00000100:00100000:0.0:1787548760.987414:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:11607:x1874380416185472:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787548760.987464:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548760.987489:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92a00/0xcb7c48919424f72f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2577 expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.987526:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fec90d93900) 00010000:00010000:0.0:1787548760.987532:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787548760.987573:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f752 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.987585:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.987594:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787548760.987968:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0b59312 reply state 00000000ac68a4d5 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548760.987978:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787548760.988079:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:11607:x1874380416185472:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 666us (855us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787548760.988087:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 228 00000100:00100000:2.0:1787548760.992304:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00010000:00010000:0.0:1787548760.993278:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.993292:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f752 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.993299:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f752 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.993304:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548760.993309:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f752 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.993329:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f752 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.993345:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fec90d93900) 00010000:00010000:0.0:1787548760.993348:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548760.993352:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f752 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.993359:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150200/0xcb7c48919424f752 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548760.993437:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416185600 00000100:00100000:1.0:1787548760.993446:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416185600 00000100:00100000:1.0:1787548760.993506:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 69 00000100:00100000:1.0:1787548760.993516:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2352:x1874380416185600:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787548760.994081:0:10297:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787548760.994087:0:10297:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787548761 -> 1787548761 00002000:00010000:1.0:1787548760.994089:0:10297:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787548760 00002000:00010000:1.0:1787548760.994092:0:10297:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787548761 -> 1787548761 00002000:00010000:1.0:1787548760.994094:0:10297:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787548760.994202:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2352:x1874380416185600:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 Request processed in 686us (1906us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787548760.994212:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 69 00000100:00100000:3.0:1787548760.997215:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548760.997428:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416185856 00000100:00100000:0.0:1787548760.997437:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416185856 00000100:00100000:0.0:1787548760.997504:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 229 00000100:00100000:0.0:1787548760.997515:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:11607:x1874380416185856:12345-192.168.206.13@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787548760.997588:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.997605:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f713 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2569 expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.997614:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.997643:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f713 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2569 expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548760.997655:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f713 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2569 expref: 20 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548760.997686:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1874380431894656:192.168.206.13@tcp:104: 00000100:00100000:0.0:1787548760.998421:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecbca32d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787548761.004365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548761.004663:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416185984 00000100:00100000:2.0:1787548761.004672:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416185984 00010000:00010000:2.0:1787548761.004760:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f713 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2569 expref: 21 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548761.004797:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 83 00000100:00100000:2.0:1787548761.004812:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:2352:x1874380416185984:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548761.004828:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548761.004837:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f713 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2569 expref: 21 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.004851:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f713 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2569 expref: 21 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.004874:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fec90d93900) 00010000:00010000:2.0:1787548761.004880:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.004890:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.004912:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.004932:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548761.004984:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:2352:x1874380416185984:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 178us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548761.004991:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 83 00000100:00080000:0.0:1787548761.007160:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787548761.007519:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f713 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2569 expref: 20 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548761.007569:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1874380431894656:192.168.206.13@tcp:104: 00010000:00010000:1.0:1787548761.007593:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.007603:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.007609:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.007641:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.007648:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.007655:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.007661:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548761.007666:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.007673:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.007688:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fec90d93900) 00010000:00010000:1.0:1787548761.007691:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787548761.007696:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.007881:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f759 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548761.007966:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:11607:x1874380416185856:12345-192.168.206.13@tcp:55:lhsmtool_posix.0 Request processed in 10452us (10758us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787548761.007976:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 229 00000100:00100000:0.0:1787548761.012505:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548761.012616:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416186112 00000100:00100000:1.0:1787548761.012626:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416186112 00000100:00100000:1.0:1787548761.012680:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 70 00000100:00100000:1.0:1787548761.012688:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2351:x1874380416186112:12345-192.168.206.13@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787548761.012880:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424f760 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.012901:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5982e27/0xcb7c48919424f73d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2585 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.012909:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548761.012914:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787548761.012919:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424f760 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.012950:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c5982e27/0xcb7c48919424f73d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2585 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.012963:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c5982e27/0xcb7c48919424f73d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2585 expref: 8 pid: 6690 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548761.012995:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5252d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1874380431894784:192.168.206.13@tcp:104: 00000100:00100000:0.0:1787548761.013193:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548761.028339:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5252d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1874380431894784:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548761.028369:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424f760 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548761.032622:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548761.032795:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416186240 00000100:00100000:2.0:1787548761.032806:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416186240 00010000:00010000:2.0:1787548761.032845:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5982e27/0xcb7c48919424f73d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2585 expref: 9 pid: 6690 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548761.032891:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 84 00000100:00100000:2.0:1787548761.032901:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+9:2351:x1874380416186240:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548761.032916:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548761.032939:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5982e27/0xcb7c48919424f73d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2585 expref: 9 pid: 6690 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.032954:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5982e27/0xcb7c48919424f73d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2585 expref: 9 pid: 6690 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.032978:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5982e27/0xcb7c48919424f73d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2585 expref: 9 pid: 6690 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.032995:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787548761.032999:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787548761.033019:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424f760 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.033029:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424f760 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.033064:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548761.033172:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2351:x1874380416186240:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 228us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548761.033181:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 84 00010000:00010000:0.0:1787548761.033925:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424f760 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.033937:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424f760 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.033967:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424f760 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.033977:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424f760 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.033985:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424f760 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.034004:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fe00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548761.034008:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424f760 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.034018:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424f760 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.034033:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424f760 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.034041:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424f760 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548761.034123:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2351:x1874380416186112:12345-192.168.206.13@tcp:1:lhsmtool_posix.0 Request processed in 21433us (21625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548761.034157:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 70 00000100:00100000:0.0:1787548761.041835:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548761.041933:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416186496 00000100:00100000:2.0:1787548761.041944:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416186496 00000100:00100000:2.0:1787548761.042006:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 230 00000100:00100000:2.0:1787548761.042015:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:11607:x1874380416186496:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787548761.042086:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f767 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.042114:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.042126:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.042359:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.042371:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f721 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2570 expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.042379:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.042425:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f721 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2570 expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.042437:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f721 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2570 expref: 20 pid: 5856 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548761.042452:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad61c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431894912:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548761.042675:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548761.053415:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad61c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431894912:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548761.053444:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548761.054851:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548761.055163:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416186624 00000100:00100000:1.0:1787548761.055173:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416186624 00010000:00010000:1.0:1787548761.055213:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f721 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2570 expref: 21 pid: 5856 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548761.055255:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 85 00000100:00100000:1.0:1787548761.055265:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:2351:x1874380416186624:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548761.055281:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548761.055294:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f721 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2570 expref: 21 pid: 5856 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.055307:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f721 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2570 expref: 21 pid: 5856 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.055329:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424f721 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2570 expref: 21 pid: 5856 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.055345:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fec90d93900) 00010000:00010000:1.0:1787548761.055350:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.055358:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.055365:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.055467:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548761.055526:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:2351:x1874380416186624:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 261us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548761.055534:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 85 00010000:00010000:0.0:1787548761.057541:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.057576:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787548761.058197:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787548761.058363:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787548761.058401:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787548761.058498:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5252300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5854:1874380431895040:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787548761.058568:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548761.058604:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787548761.058752:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431895040 00000100:00100000:0.0:1787548761.058760:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431895040 00000100:00100000:0.0:1787548761.058809:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787548761.058817:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1874380431895040:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787548761.058895:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1874380431895040:12345-0@lo:1000:mdt00_000.0 Request processed in 78us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548761.058903:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787548761.059038:0:5854:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1787548761.059043:0:5854:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:1.0:1787548761.059059:0:5854:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8feca2f3f800, transno 4294967321 00000004:00080000:1.0:1787548761.059072:0:5854:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8feca00a8380, transno 4294967322 00000100:00100000:1.0:1787548761.059078:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5252300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5854:1874380431895040:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787548761.059534:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787548761.059597:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5252300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5854:1874380431895168:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787548761.059629:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548761.059647:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd4b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548761.059720:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431895168 00000100:00100000:2.0:1787548761.059725:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431895168 00000100:00100000:2.0:1787548761.059762:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787548761.059769:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1874380431895168:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787548761.059933:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5854:x1874380431895168:12345-0@lo:1000:mdt00_000.0 Request processed in 163us (303us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787548761.059940:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787548761.061898:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5252300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5854:1874380431895168:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787548761.061945:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.061956:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.061964:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.061986:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548761.061991:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.061998:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.062015:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fec90d93900) 00010000:00010000:1.0:1787548761.062018:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787548761.062022:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.062028:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f76e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.062060:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f6b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.062066:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f6b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.062072:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f6b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.062077:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548761.062079:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f6b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.062085:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f6b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.062107:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:1.0:1787548761.062109:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787548761.062115:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f6b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2554 expref: 23 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.062127:0:5854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f6b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2554 expref: 23 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.062167:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f6b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2554 expref: 23 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.062201:0:5854:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f6b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2554 expref: 23 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548761.062214:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5250700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431895296:192.168.206.13@tcp:105: 00000100:00100000:1.0:1787548761.062295:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd4b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548761.065578:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548761.065645:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416186752 00000100:00100000:3.0:1787548761.065654:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416186752 00000100:00100000:3.0:1787548761.065718:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 61 00000100:00100000:3.0:1787548761.065729:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+24:11606:x1874380416186752:12345-192.168.206.13@tcp:49:lfs.0 00000100:00100000:3.0:1787548761.065860:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+24:11606:x1874380416186752:12345-192.168.206.13@tcp:49:lfs.0 Request processed in 132us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548761.065880:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 61 00000100:00100000:1.0:1787548761.068658:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5250700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1874380431895296:192.168.206.13@tcp:105: 00010000:00010000:1.0:1787548761.068687:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f6b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.068698:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151400/0xcb7c48919424f6b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.068731:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f775 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.068757:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f775 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069081:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f775 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069193:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f775 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069200:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f775 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069206:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f775 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069212:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548761.069216:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f775 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069224:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f775 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069236:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:1.0:1787548761.069239:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548761.069242:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f775 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069247:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f600/0xcb7c48919424f775 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069258:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069264:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f767 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069278:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f767 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069283:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548761.069286:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f767 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069293:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f767 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069302:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:1.0:1787548761.069305:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787548761.069308:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f767 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548761.069314:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f767 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548761.069949:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+23:11607:x1874380416186496:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 27929us (28119us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1787548761.069961:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 230 00000020:00080000:1.0:1787548761.069967:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787548761.070048:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787548761.070054:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787548761.070798:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787548761.070806:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787548761.075891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548761.075939:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548761.076077:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416187008 00000100:00100000:2.0:1787548761.076087:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416187008 00000100:00100000:2.0:1787548761.076175:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 231 00000100:00100000:2.0:1787548761.076187:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+23:11606:x1874380416187008:12345-192.168.206.13@tcp:58:lfs.0 00000100:00100000:0.0:1787548761.076404:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416187264 00000100:00100000:0.0:1787548761.076408:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416187264 00000100:00100000:0.0:1787548761.076446:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 62 00000100:00100000:0.0:1787548761.076453:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca6f14450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+24:11607:x1874380416187264:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1787548761.076549:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787548761.076643:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+25:11606:x1874380416187008:12345-192.168.206.13@tcp:58:lfs.0 Request processed in 459us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548761.076650:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 231 00000004:00080000:0.0:1787548761.076948:0:5858:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787548761.077056:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1787548761.077097:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f77c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.077812:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f77c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.077826:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f77c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.077835:0:5858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f77c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.077841:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f77c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.077846:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f77c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.077875:0:5858:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787548761.077961:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca6f14450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+25:11607:x1874380416187264:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 Request processed in 1507us (2020us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787548761.077970:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 62 00000020:00080000:0.0:1787548761.077975:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787548761.077984:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548761.077991:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f77c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.077997:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150000 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548761.078000:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f77c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.078007:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f77c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.078019:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8feca2cf6700) 00010000:00010000:2.0:1787548761.078022:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787548761.078027:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f77c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.078033:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150000/0xcb7c48919424f77c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.078049:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548761.078051:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548761.078052:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548761.133745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548761.133856:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416187392 00000100:00100000:2.0:1787548761.133866:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416187392 00000100:00100000:2.0:1787548761.133923:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 232 00000100:00100000:2.0:1787548761.133933:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+25:11609:x1874380416187392:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548761.133955:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548761.133973:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f783 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a258c expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.134034:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f78a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.134056:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f78a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.134069:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f78a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.134084:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f791 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.134090:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.134096:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.134407:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f798 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.134421:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a254d expref: 26 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.134430:0:8467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f798 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.134464:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a254d expref: 26 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548761.134478:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a254d expref: 26 pid: 5856 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548761.134503:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad61d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431895424:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548761.134604:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787548761.140713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548761.140768:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416187648 00000100:00100000:0.0:1787548761.140777:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416187648 00000100:00100000:2.0:1787548761.140822:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad61d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8467:1874380431895424:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548761.140854:0:8467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f798 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548761.140886:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 63 00000100:00100000:0.0:1787548761.140905:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+27:5593:x1874380416187648:12345-192.168.206.13@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787548761.141465:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+28:5593:x1874380416187648:12345-192.168.206.13@tcp:35:ldlm_bl.0 Request processed in 569us (766us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787548761.141474:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 63 00000100:00100000:2.0:1787548761.159516:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548761.159605:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416187776 00000100:00100000:3.0:1787548761.159616:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416187776 00010000:00010000:3.0:1787548761.159654:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a254d expref: 28 pid: 5856 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548761.159695:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 86 00000100:00100000:3.0:1787548761.159715:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+28:2354:x1874380416187776:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548761.159729:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548761.159736:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a254d expref: 28 pid: 5856 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548761.159758:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a254d expref: 28 pid: 5856 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548761.159779:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150800/0xcb7c48919424f6a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a254d expref: 28 pid: 5856 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548761.159794:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:3.0:1787548761.159811:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f798 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548761.159820:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548761.159827:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f798 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548761.159868:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548761.159922:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+27:2354:x1874380416187776:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 218us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548761.159929:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 86 00010000:00010000:0.0:1787548761.159987:0:8467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.159997:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548761.160044:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787548761.160048:0:8467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548761.160067:0:8467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160080:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160096:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f78a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160112:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f78a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160119:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f78a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160125:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f7200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548761.160328:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f78a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160337:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f78a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160347:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:0.0:1787548761.160350:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548761.160354:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f78a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160359:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7200/0xcb7c48919424f78a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160373:0:8467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160379:0:8467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f791 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160384:0:8467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f791 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160389:0:8467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548761.160398:0:8467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f791 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160403:0:8467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f791 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160410:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fec87cebf00) 00010000:00010000:0.0:1787548761.160412:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548761.160415:0:8467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f791 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160420:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f791 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160455:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f783 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a258c expref: 27 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160468:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a258c expref: 26 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548761.160475:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:0.0:1787548761.160477:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548761.160480:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6000, rc 0) 00000100:00100000:1.0:1787548761.164517:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+26:11609:x1874380416187392:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 30573us (30768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548761.164531:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 232 00010000:00010000:1.0:1787548761.552392:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787548762.003317:0:12520:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787548762.003327:0:12520:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787548762.003385:0:12520:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787548762.003391:0:12520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787548762.116202:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787548762.116211:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787548762.116265:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787548762.116271:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787548762.116399:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874380431895552:192.168.206.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787548762.116499:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecbca32540 going to sleep for 11 seconds 00000100:00100000:3.0:1787548762.129658:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874380431895552:192.168.206.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787548762.138080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548762.138213:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416187904 00000100:00100000:1.0:1787548762.138223:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416187904 00000100:00100000:1.0:1787548762.138289:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 233 00000100:00100000:1.0:1787548762.138312:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+26:11621:x1874380416187904:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787548762.138347:0:5855:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787548762.138458:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+26:11621:x1874380416187904:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 Request processed in 147us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548762.138466:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 233 00000100:00100000:1.0:1787548762.154505:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548762.154600:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416188160 00000100:00100000:3.0:1787548762.154610:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416188160 00000100:00100000:3.0:1787548762.154660:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 234 00000100:00100000:3.0:1787548762.154670:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+26:11621:x1874380416188160:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787548762.154688:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548762.154708:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f79f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2593 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548762.154802:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f7a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548762.154816:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548762.154829:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548762.154852:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787548762.154973:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92c00/0xcb7c48919424f79f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2593 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548762.155004:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f7a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2593 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548762.155014:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:3.0:1787548762.155025:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787548762.155030:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92e00, rc 0) 00000100:00100000:3.0:1787548762.155089:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+28:11621:x1874380416188160:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 420us (591us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787548762.155096:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 234 00000100:00100000:3.0:1787548762.170244:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548762.171635:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548762.175577:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416188288 00000100:00100000:1.0:1787548762.176008:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416188288 00000100:00100000:1.0:1787548762.176703:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 17 00000100:00100000:1.0:1787548762.176714:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec882a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+28:2353:x1874380416188288:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548762.176730:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548762.176753:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424f7a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2593 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548762.176770:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:1.0:1787548762.176775:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548762.176828:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec882a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+27:2353:x1874380416188288:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 116us (6592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548762.176834:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 17 00000100:00100000:1.0:1787548762.176883:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416188544 00000100:00100000:1.0:1787548762.176888:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416188544 00000100:00100000:1.0:1787548762.176927:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 235 00000100:00100000:1.0:1787548762.176934:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+27:11621:x1874380416188544:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787548762.176994:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f7b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548762.177818:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548762.177834:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548762.178029:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548762.178038:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f7b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548762.178046:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f7b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548762.178051:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fe00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548762.178055:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f7b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548762.178063:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f7b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548762.178073:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:1.0:1787548762.178076:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787548762.178081:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f7b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548762.178087:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22fe00/0xcb7c48919424f7b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548762.180467:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+28:11621:x1874380416188544:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 3521us (8826us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787548762.180490:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 235 00000040:00080000:3.0:1787548762.186746:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787548762.186754:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787548762.188007:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787548762.188719:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787548762.201112:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548762.201179:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416188800 00000100:00100000:0.0:1787548762.201189:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416188800 00000100:00100000:0.0:1787548762.201241:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 64 00000100:00100000:0.0:1787548762.201251:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+28:11621:x1874380416188800:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787548762.201490:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+29:11621:x1874380416188800:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 Request processed in 238us (396us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787548762.201497:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 64 00010000:00010000:2.0:1787548762.563955:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548763.590010:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787548763.744646:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1787548763.744668:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1787548763.744685:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000040:00080000:1.0:1787548764.053404:0:12573:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787548764.053414:0:12573:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787548764.053800:0:12573:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787548764.053806:0:12573:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787548764.214323:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548764.214366:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548764.214395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548764.214415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548764.214436:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548764.214476:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416189440 00000100:00100000:0.0:1787548764.214484:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416189440 00000100:00100000:0.0:1787548764.214534:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416189056 00000100:00100000:0.0:1787548764.214549:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416189056 00000100:00100000:0.0:1787548764.214575:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 147 00000100:00100000:0.0:1787548764.214584:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416189440:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548764.214652:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92088e20-066b-499e-ac52-ab10992c506a+5:2354:x1874380416189440:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 68us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548764.214659:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 147 00000100:00100000:0.0:1787548764.214674:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 148 00000100:00100000:0.0:1787548764.214680:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+29:2354:x1874380416189056:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548764.214739:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+29:2354:x1874380416189056:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 59us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548764.214746:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 148 00000100:00100000:0.0:1787548764.214764:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416189184 00000100:00100000:0.0:1787548764.214767:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416189184 00000100:00100000:0.0:1787548764.214789:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416189312 00000100:00100000:0.0:1787548764.214791:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416189312 00000100:00100000:0.0:1787548764.214809:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 70 00000100:00100000:0.0:1787548764.214815:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2354:x1874380416189184:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548764.214839:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2354:x1874380416189184:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 25us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548764.214847:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 70 00000100:00100000:0.0:1787548764.214858:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 71 00000100:00100000:0.0:1787548764.214864:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2354:x1874380416189312:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548764.214887:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2354:x1874380416189312:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 23us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548764.214893:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 71 00000100:00080000:0.0:1787548764.214907:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787548764.214911:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787548764.214913:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548764.215411:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416188928 00000100:00100000:3.0:1787548764.215418:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416188928 00000100:00100000:3.0:1787548764.215458:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 292 00000100:00100000:3.0:1787548764.215466:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2354:x1874380416188928:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548764.215511:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2354:x1874380416188928:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 46us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548764.215519:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 292 00000100:00100000:3.0:1787548764.282416:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548764.282820:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416189696 00000100:00100000:2.0:1787548764.282830:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416189696 00000100:00100000:2.0:1787548764.282895:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 236 00000100:00100000:2.0:1787548764.282905:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+29:11642:x1874380416189696:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548764.282925:0:8467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548764.282945:0:8467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f7bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a259a expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548764.283049:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f7c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548764.283062:0:8467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548764.283087:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548764.283099:0:8467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787548764.283249:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f7bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a259a expref: 32 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548764.283265:0:8467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f7c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a259a expref: 31 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548764.283273:0:8467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:2.0:1787548764.283276:0:8467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787548764.283280:0:8467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6200, rc 0) 00000100:00100000:2.0:1787548764.283334:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+31:11642:x1874380416189696:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 431us (934us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787548764.283341:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 236 00000100:00100000:0.0:1787548764.295193:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548764.295228:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416189824 00000100:00100000:0.0:1787548764.295236:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416189824 00000100:00100000:0.0:1787548764.295289:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 237 00000100:00100000:0.0:1787548764.295300:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+31:11642:x1874380416189824:12345-192.168.206.13@tcp:54:lfs.0 00010000:00010000:0.0:1787548764.295370:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f7d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548764.295400:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548764.295431:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548764.295463:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548764.295470:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f7d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548764.295478:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548764.295484:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548764.295488:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548764.295496:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f7d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548764.295507:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:0.0:1787548764.295510:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787548764.295515:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f7d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548764.295520:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424f7d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548764.295596:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+31:11642:x1874380416189824:12345-192.168.206.13@tcp:54:lfs.0 Request processed in 297us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548764.295609:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 237 00000100:00100000:2.0:1787548764.420348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548764.420438:0:10297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416189952 00000100:00100000:0.0:1787548764.420448:0:10297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416189952 00000100:00100000:0.0:1787548764.420509:0:10297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 71 00000100:00100000:0.0:1787548764.420519:0:10297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad61c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2352:x1874380416189952:12345-192.168.206.13@tcp:101:cat.0 00010000:00010000:0.0:1787548764.420547:0:10297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548764.420567:0:10297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f7d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a25a1 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787548764.420597:0:10297:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8bd459, atime: 0x6a8bd458, ctime: 0x6a8bd459, blocks: 0xb 00010000:00010000:0.0:1787548764.420617:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=387s v=(0 0) 00010000:00010000:0.0:1787548764.420622:0:10297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787548764.420631:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f7d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25a1 expref: 8 pid: 10297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548764.420650:0:10297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f7d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25a1 expref: 8 pid: 10297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548764.420661:0:10297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150600, rc 0) 00000100:00100000:0.0:1787548764.420729:0:10297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad61c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2352:x1874380416189952:12345-192.168.206.13@tcp:101:cat.0 Request processed in 211us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548764.420735:0:10297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 71 00000100:00100000:3.0:1787548764.428528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548764.428691:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416190080 00000100:00100000:2.0:1787548764.428701:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416190080 00002000:00100000:2.0:1787548764.428759:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8fecbd0c9880 x1874380416190080/t0(0) o3->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:205/0 lens 488/0 e 0 to 0 dl 1787548775 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787548764.428769:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fecbd0c9880 with x1874380416190080 ext(0->4095) 00002000:00010000:2.0:1787548764.428775:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fecbd0c9880 00000100:00100000:2.0:1787548764.428807:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:2.0:1787548764.428817:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2351:x1874380416190080:12345-192.168.206.13@tcp:3:cat.0 00000100:00100000:2.0:1787548764.429257:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+8:2351:x1874380416190080:12345-192.168.206.13@tcp:3:cat.0 Request processed in 439us (736us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787548764.429272:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 7 00002000:00100000:2.0:1787548764.429280:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8fecbd0c9880 x1874380416190080/t0(0) o3->e4505aba-b49a-4ae4-be2d-9f5ba513779c@192.168.206.13@tcp:205/0 lens 488/4536 e 0 to 0 dl 1787548775 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787548764.429289:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fecbd0c9880 with x1874380416190080 ext(0->4095) 00002000:00010000:2.0:1787548764.429293:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fecbd0c9880 00010000:00010000:2.0:1787548764.611532:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548765.638559:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548765.704328:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad61df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431895680:0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.704407:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548765.704449:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad61e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431896192:0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.704474:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548765.704497:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787548765.704502:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad61d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431895808:0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.704551:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548765.704571:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad63e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431896320:0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.704593:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548765.704616:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431895936:0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.704638:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548765.704659:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad63c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431896448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787548765.704691:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548765.704711:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787548765.704717:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431896064:0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.704737:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548765.704764:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431895680 00000100:00100000:2.0:1787548765.704770:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431895680 00000100:00100000:2.0:1787548765.704822:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787548765.704830:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431895680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.704873:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431895680:12345-0@lo:400:kworker.0 Request processed in 43us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548765.704879:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787548765.704908:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431896192 00000100:00100000:2.0:1787548765.704911:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431896192 00000100:00100000:2.0:1787548765.704942:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431895808 00000100:00100000:2.0:1787548765.704944:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431895808 00000100:00100000:2.0:1787548765.704955:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431895936 00000100:00100000:2.0:1787548765.704957:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431895936 00000100:00100000:2.0:1787548765.704972:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787548765.704978:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad63f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431896192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.705008:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad63f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431896192:12345-0@lo:400:kworker.0 Request processed in 30us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548765.705014:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787548765.705026:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787548765.705031:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431895808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.705211:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431895808:12345-0@lo:400:kworker.0 Request processed in 25us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548765.705219:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787548765.705233:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787548765.705239:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431895936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.705273:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431895936:12345-0@lo:400:kworker.0 Request processed in 36us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548765.705279:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787548765.705298:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431896320 00000100:00100000:2.0:1787548765.705308:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431896320 00000100:00100000:2.0:1787548765.705335:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431896064 00000100:00100000:2.0:1787548765.705338:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431896064 00000100:00100000:2.0:1787548765.705357:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787548765.705363:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874380431896320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.705392:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874380431896320:12345-0@lo:400:kworker.0 Request processed in 29us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548765.705397:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787548765.705407:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787548765.705412:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431896064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.705436:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431896064:12345-0@lo:400:kworker.0 Request processed in 23us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548765.705441:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787548765.705472:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787548765.705477:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fecad099c00, transno 4294967307 00000004:00080000:2.0:1787548765.705486:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1787548765.705501:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fecbd0c9c00, transno 4294967310 00000100:00100000:2.0:1787548765.705507:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431896064:0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.705519:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431895936:0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.705556:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad61d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431895808:0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.705566:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad63e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431896320:0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.705575:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad61df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431895680:0@lo:400:kworker.0 00000100:00100000:2.0:1787548765.705584:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad61e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431896192:0@lo:400:kworker.0 00000100:00100000:0.0:1787548765.707271:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431896448 00000100:00100000:0.0:1787548765.707280:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431896448 00000100:00100000:0.0:1787548765.707328:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787548765.707337:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431896448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787548765.707382:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548765.707465:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431896448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548765.707472:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1787548765.707495:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787548765.707499:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787548765.707503:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548765.707561:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad63c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431896448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548765.707577:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787548765.707585:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431896576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548765.707618:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548765.707646:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431896576 00000100:00100000:0.0:1787548765.707650:0:11969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431896576 00000100:00100000:0.0:1787548765.707669:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787548765.707675:0:11969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874380431896576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787548765.707705:0:11969:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548765.707926:0:11969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874380431896576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 250us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548765.707933:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787548765.708352:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431896576:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787548766.278824:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1787548766.278844:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1787548766.296905:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:3.0:1787548766.296947:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fecacd4be40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787548766.296953:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8feca7696300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fecacd4b0c0 00000020:00080000:3.0:1787548766.296958:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8feca7696100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fecbd106400 00000001:00080000:3.0:1787548766.296984:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1787548766.296996:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1787548766.297264:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787548766.297442:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1787548766.660741:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787548767.303577:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787548767.303586:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787548767.303627:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787548767.303633:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787548767.683240:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548768.707587:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548769.334574:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548769.334614:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548769.334633:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548769.334648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548769.334674:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548769.336400:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416190208 00000100:00100000:2.0:1787548769.336413:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416190208 00000100:00100000:2.0:1787548769.336477:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 294 00000100:00100000:2.0:1787548769.336489:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2353:x1874380416190208:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548769.337080:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2353:x1874380416190208:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 592us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548769.337090:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 294 00000100:00100000:2.0:1787548769.337150:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416190464 00000100:00100000:2.0:1787548769.337155:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416190464 00000100:00100000:2.0:1787548769.337207:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416190592 00000100:00100000:2.0:1787548769.337211:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416190592 00000100:00100000:2.0:1787548769.337240:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 74 00000100:00100000:2.0:1787548769.337248:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416190464:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548769.337284:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2353:x1874380416190464:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 37us (2669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548769.337292:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 74 00000100:00100000:2.0:1787548769.337311:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 75 00000100:00100000:2.0:1787548769.337319:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2353:x1874380416190592:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548769.337352:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2353:x1874380416190592:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 35us (2677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548769.337359:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 75 00000100:00100000:2.0:1787548769.337383:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416190720 00000100:00100000:2.0:1787548769.337386:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416190720 00000100:00100000:2.0:1787548769.337418:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416190336 00000100:00100000:2.0:1787548769.337421:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416190336 00000100:00100000:2.0:1787548769.337449:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 152 00000100:00100000:2.0:1787548769.337472:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92088e20-066b-499e-ac52-ab10992c506a+5:2353:x1874380416190720:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548769.338635:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92088e20-066b-499e-ac52-ab10992c506a+5:2353:x1874380416190720:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 1160us (3993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548769.338646:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 152 00000100:00100000:2.0:1787548769.338670:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 153 00000100:00100000:2.0:1787548769.338680:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:2353:x1874380416190336:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548769.338723:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:2353:x1874380416190336:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 46us (4073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548769.338730:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 153 00000100:00080000:0.0:1787548769.341593:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787548769.341602:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787548769.341606:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787548769.732281:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548770.094387:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548770.094537:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416190848 00000100:00100000:0.0:1787548770.094546:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416190848 00000100:00100000:0.0:1787548770.094615:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 238 00000100:00100000:0.0:1787548770.094625:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:11295:x1874380416190848:12345-192.168.206.13@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787548770.094745:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:11295:x1874380416190848:12345-192.168.206.13@tcp:60:lhsmtool_posix.0 Request processed in 121us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548770.094753:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 238 00000100:00100000:3.0:1787548770.098661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548770.098770:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416191104 00000100:00100000:0.0:1787548770.098779:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416191104 00000100:00100000:0.0:1787548770.098836:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 65 00000100:00100000:0.0:1787548770.098846:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:11295:x1874380416191104:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787548770.099556:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:11295:x1874380416191104:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 Request processed in 707us (900us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787548770.099567:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 65 00000100:00100000:3.0:1787548770.485906:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548770.486029:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416191232 00000100:00100000:2.0:1787548770.486047:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416191232 00000100:00100000:2.0:1787548770.486212:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 239 00000100:00100000:2.0:1787548770.486223:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92088e20-066b-499e-ac52-ab10992c506a+5:12094:x1874380416191232:12345-192.168.206.13@tcp:101:lsof.0 00010000:00010000:2.0:1787548770.486243:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548770.486263:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f7de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a25a8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548770.486326:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f7e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548770.486341:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548770.486354:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548770.486583:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787548770.486588:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548770.486674:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548770.486705:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f7600/0xcb7c48919424f7de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25a8 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548770.486723:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25a8 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548770.486732:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2d51600) 00010000:00010000:2.0:1787548770.486735:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787548770.486738:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6c00, rc 0) 00000100:00100000:2.0:1787548770.486806:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92088e20-066b-499e-ac52-ab10992c506a+6:12094:x1874380416191232:12345-192.168.206.13@tcp:101:lsof.0 Request processed in 585us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548770.486813:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 239 00010000:00010000:2.0:1787548770.755364:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548770.822050:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787548770.822076:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431896704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548770.822164:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548770.822276:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431896704 00000100:00100000:0.0:1787548770.822284:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431896704 00000100:00100000:0.0:1787548770.822348:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787548770.822357:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431896704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787548770.822389:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548770.822440:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431896704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548770.822447:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787548770.822525:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787548770.822550:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787548770.822556:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787548770.822581:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431896704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548770.823091:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431896832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548770.823125:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548770.823446:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431896832 00000100:00100000:2.0:1787548770.823452:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431896832 00000100:00100000:2.0:1787548770.823514:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787548770.823523:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431896832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787548770.823547:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548770.823588:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431896832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548770.823594:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787548770.823762:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431897216:0@lo:400:kworker.0 00000100:00100000:3.0:1787548770.823796:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548770.823824:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787548770.823830:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431897344:0@lo:400:kworker.0 00000100:00100000:3.0:1787548770.823853:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787548770.823917:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548770.823949:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431896832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548770.824016:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431897216 00000100:00100000:0.0:1787548770.824020:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431897216 00000100:00100000:0.0:1787548770.824063:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431897344 00000100:00100000:0.0:1787548770.824066:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431897344 00000100:00100000:0.0:1787548770.824086:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787548770.824094:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431897216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548770.824172:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431897216:12345-0@lo:400:kworker.0 Request processed in 78us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548770.824179:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787548770.824192:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787548770.824198:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431897344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548770.824224:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431897344:12345-0@lo:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548770.824230:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1787548770.824286:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548770.824342:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431897344:0@lo:400:kworker.0 00000100:00100000:3.0:1787548770.824350:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431897216:0@lo:400:kworker.0 00000100:00100000:2.0:1787548770.824460:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431896960:0@lo:400:kworker.0 00000100:00100000:2.0:1787548770.824500:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548770.824544:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787548770.824550:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431897088:0@lo:400:kworker.0 00000100:00100000:2.0:1787548770.824573:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548770.824610:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431897088 00000100:00100000:2.0:1787548770.824614:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431897088 00000100:00100000:2.0:1787548770.824655:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787548770.824663:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431897088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548770.824700:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431897088:12345-0@lo:400:kworker.0 Request processed in 39us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548770.824707:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787548770.824732:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431897088:0@lo:400:kworker.0 00000100:00100000:3.0:1787548770.824841:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431896960 00000100:00100000:3.0:1787548770.824845:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431896960 00000100:00100000:3.0:1787548770.824883:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787548770.824890:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431896960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548770.824925:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431896960:12345-0@lo:400:kworker.0 Request processed in 35us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548770.824931:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787548770.825072:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431896960:0@lo:400:kworker.0 00000001:00080000:3.0:1787548771.429197:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1787548771.429227:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787548771.429248:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787548771.429258:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1787548771.779304:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548772.803359:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548773.827411:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787548774.272866:0:12777:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:19:33 (1787548773) 00000100:00100000:2.0:1787548774.459203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548774.459287:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548774.459327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548774.459350:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548774.459370:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548774.459394:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416191616 00000100:00100000:2.0:1787548774.459402:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416191616 00000100:00100000:2.0:1787548774.459454:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416191744 00000100:00100000:2.0:1787548774.459458:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416191744 00000100:00100000:2.0:1787548774.459494:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 76 00000100:00100000:2.0:1787548774.459504:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416191616:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548774.460473:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2351:x1874380416191616:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 967us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548774.460498:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 76 00000100:00100000:2.0:1787548774.460765:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 77 00000100:00100000:2.0:1787548774.460778:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2351:x1874380416191744:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548774.460811:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2351:x1874380416191744:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 37us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548774.460818:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 77 00000100:00100000:2.0:1787548774.460839:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416191872 00000100:00100000:2.0:1787548774.460844:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416191872 00000100:00100000:2.0:1787548774.460876:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416191488 00000100:00100000:2.0:1787548774.460880:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416191488 00000100:00100000:2.0:1787548774.460903:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 157 00000100:00100000:2.0:1787548774.460910:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+6:2351:x1874380416191872:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548774.460939:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92088e20-066b-499e-ac52-ab10992c506a+6:2351:x1874380416191872:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 30us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548774.460945:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 157 00000100:00100000:2.0:1787548774.460956:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 158 00000100:00100000:2.0:1787548774.460962:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:2351:x1874380416191488:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548774.460987:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:2351:x1874380416191488:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 25us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548774.460993:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 158 00000100:00080000:2.0:1787548774.461013:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787548774.461017:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787548774.461020:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787548774.464637:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416191360 00000100:00100000:0.0:1787548774.464652:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416191360 00000100:00100000:0.0:1787548774.464705:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 296 00000100:00100000:0.0:1787548774.464715:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2351:x1874380416191360:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548774.464788:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2351:x1874380416191360:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 74us (5593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548774.464795:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 296 00010000:00010000:0.0:1787548774.856447:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548775.897009:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548775.939462:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787548775.939507:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb5252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431897472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548775.939572:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548775.939639:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431897600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548775.939663:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548775.939697:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431897472 00000100:00100000:1.0:1787548775.939703:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431897472 00000100:00100000:2.0:1787548775.939716:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431897600 00000100:00100000:2.0:1787548775.939721:0:11969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431897600 00000100:00100000:2.0:1787548775.939754:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787548775.939763:0:11969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431897600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787548775.939796:0:11969:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548775.939840:0:11969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431897600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548775.939847:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787548775.939863:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787548775.939869:0:11969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431897472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787548775.939886:0:11969:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548775.939911:0:11969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431897472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548775.939917:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787548775.941847:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787548775.941856:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787548775.941874:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431897856:0@lo:400:kworker.0 00000100:00100000:1.0:1787548775.941942:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548775.941985:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787548775.941992:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431897728:0@lo:400:kworker.0 00000100:00100000:1.0:1787548775.942019:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548775.942054:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431897728 00000100:00100000:1.0:1787548775.942061:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431897728 00000100:00100000:1.0:1787548775.942104:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787548775.942112:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3314:x1874380431897728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548775.942181:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3314:x1874380431897728:12345-0@lo:400:kworker.0 Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548775.942188:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787548775.942234:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431897728:0@lo:400:kworker.0 00000100:00100000:1.0:1787548775.942258:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431898112:0@lo:400:kworker.0 00000100:00100000:1.0:1787548775.942282:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548775.942316:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431897600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548775.942330:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb5252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431897472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548775.942355:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787548775.942362:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874380431897984:0@lo:400:kworker.0 00000100:00100000:1.0:1787548775.942385:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548775.942410:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431897856 00000100:00100000:1.0:1787548775.942414:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431897856 00000100:00100000:1.0:1787548775.942440:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431898112 00000100:00100000:1.0:1787548775.942443:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431898112 00000100:00100000:1.0:1787548775.942461:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431897984 00000100:00100000:1.0:1787548775.942463:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431897984 00000100:00100000:1.0:1787548775.942489:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787548775.942495:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431897856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548775.942535:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431897856:12345-0@lo:400:kworker.0 Request processed in 40us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548775.942540:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787548775.942552:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787548775.942557:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431898112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548775.943862:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787548775.943881:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874380431897984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548775.945184:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431897856:0@lo:400:kworker.0 00000100:00080000:0.0:1787548775.945219:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548775.946375:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874380431897984:12345-0@lo:400:kworker.0 Request processed in 2497us (3983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548775.946387:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787548775.946782:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431898112:12345-0@lo:400:kworker.0 Request processed in 4221us (4496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548775.946791:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787548775.946834:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874380431897984:0@lo:400:kworker.0 00000100:00100000:1.0:1787548775.946846:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431898112:0@lo:400:kworker.0 00010000:00010000:2.0:1787548776.899951:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787548777.539392:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787548777.539403:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787548777.540395:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787548777.540404:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787548777.923557:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548778.176270:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548778.176380:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416192128 00000100:00100000:0.0:1787548778.176390:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416192128 00000100:00100000:0.0:1787548778.176474:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 66 00000100:00100000:0.0:1787548778.176485:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+18:12315:x1874380416192128:12345-192.168.206.13@tcp:35:umount.0 00000100:00100000:0.0:1787548778.176967:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:12315:x1874380416192128:12345-192.168.206.13@tcp:35:umount.0 Request processed in 482us (703us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787548778.176976:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 66 00000100:00080000:1.0:1787548778.180200:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548778.182018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548778.182179:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416192384 00000100:00100000:0.0:1787548778.182188:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416192384 00000100:00100000:0.0:1787548778.182242:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 67 00000100:00100000:0.0:1787548778.182252:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+19:12315:x1874380416192384:12345-192.168.206.13@tcp:35:umount.0 00000100:00100000:0.0:1787548778.182681:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:12315:x1874380416192384:12345-192.168.206.13@tcp:35:umount.0 Request processed in 429us (670us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787548778.182690:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 67 00000100:00100000:2.0:1787548778.191738:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548778.191829:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416192640 00000100:00100000:3.0:1787548778.191838:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416192640 00000100:00100000:3.0:1787548778.191905:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 68 00000100:00100000:3.0:1787548778.191915:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca6f15850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+20:12315:x1874380416192640:12345-192.168.206.13@tcp:35:umount.0 00000100:00100000:3.0:1787548778.192452:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca6f15850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:12315:x1874380416192640:12345-192.168.206.13@tcp:35:umount.0 Request processed in 537us (721us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787548778.192470:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 68 00000100:00100000:2.0:1787548778.199906:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548778.206020:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416192896 00000100:00100000:3.0:1787548778.206050:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416192896 00000100:00100000:3.0:1787548778.206113:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 69 00000100:00100000:3.0:1787548778.206123:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:12315:x1874380416192896:12345-192.168.206.13@tcp:35:umount.0 00000100:00100000:3.0:1787548778.206452:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+22:12315:x1874380416192896:12345-192.168.206.13@tcp:35:umount.0 Request processed in 329us (6554us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787548778.206470:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 69 00000100:00100000:1.0:1787548778.210960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548778.211012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548778.211085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548778.211178:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416193024 00000100:00100000:1.0:1787548778.211190:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416193024 00000100:00100000:1.0:1787548778.211259:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416193280 00000100:00100000:1.0:1787548778.211262:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416193280 00000100:00100000:1.0:1787548778.211276:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416193152 00000100:00100000:1.0:1787548778.211278:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416193152 00000100:00100000:1.0:1787548778.211303:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00100000:1.0:1787548778.211315:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:450a7108-39f6-4004-8f60-5d2336e0cad2+15:2352:x1874380416193024:12345-192.168.206.13@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787548778.211334:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 19 00010000:00010000:1.0:1787548778.211336:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787548778.211361:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb5252a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:450a7108-39f6-4004-8f60-5d2336e0cad2+15:2352:x1874380416193280:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548778.211379:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec90151a00/0xcb7c48919424e7fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2133 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548778.211386:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548778.211409:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787548778.211419:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecbd22e600/0xcb7c48919424ea71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21fe expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548778.211438:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548778.211496:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2352:x1874380416193024:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 180us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548778.211507:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb5252a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:450a7108-39f6-4004-8f60-5d2336e0cad2+13:2352:x1874380416193280:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 155us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548778.211509:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00100000:0.0:1787548778.211526:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 19 00000100:00100000:1.0:1787548778.211547:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00100000:1.0:1787548778.211561:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:450a7108-39f6-4004-8f60-5d2336e0cad2+11:2352:x1874380416193152:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548778.211573:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548778.211586:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec90151000/0xcb7c48919424e7c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a20fb expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548778.211598:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548778.211627:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2352:x1874380416193152:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 71us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548778.211648:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00100000:2.0:1787548778.221441:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548778.221555:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416193664 00000100:00100000:0.0:1787548778.221569:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416193664 00000100:00100000:0.0:1787548778.221656:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 72 00000100:00100000:0.0:1787548778.221668:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+7:2350:x1874380416193664:12345-192.168.206.13@tcp:9:umount.0 00000020:00000080:0.0:1787548778.221707:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424ed9d 00000020:00010000:0.0:1787548778.221716:0:6691:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8feb81f25000: total 0 00000100:00080000:0.0:1787548778.221721:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8fec8381a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787548778.221779:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787548778.222112:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2350:x1874380416193664:12345-192.168.206.13@tcp:9:umount.0 Request processed in 445us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548778.222171:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 72 00000020:00010000:3.0:1787548778.222294:0:5842:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8feb81f25000: total 0 00010000:00010000:3.0:1787548778.222334:0:5842:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8feb81f25000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787548778.222404:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b3acc2a/0xcb7c48919424f139 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23d3 expref: 4 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548778.222443:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbf633e4/0xcb7c48919424f7d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25a1 expref: 3 pid: 10297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548778.222458:0:5842:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8feb81f25000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787548778.222481:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548778.222484:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548778.222486:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787548778.222538:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787548778.227528:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548778.227677:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416193792 00000100:00100000:2.0:1787548778.227689:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416193792 00000100:00100000:2.0:1787548778.227790:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 73 00000100:00100000:2.0:1787548778.227804:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+5:2350:x1874380416193792:12345-192.168.206.13@tcp:9:umount.0 00000020:00000080:2.0:1787548778.227853:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424eb35 00000100:00080000:2.0:1787548778.227866:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8fec8366e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787548778.227925:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787548778.228307:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+2:2350:x1874380416193792:12345-192.168.206.13@tcp:9:umount.0 Request processed in 505us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548778.228317:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 73 00000100:00080000:1.0:1787548778.228457:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787548778.229015:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548778.241759:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548778.242393:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416194816 00000100:00100000:0.0:1787548778.242576:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416194816 00000100:00100000:0.0:1787548778.242902:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 240 00000100:00100000:0.0:1787548778.242919:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+22:2350:x1874380416194816:12345-192.168.206.13@tcp:39:umount.0 00000020:00000080:0.0:1787548778.242964:0:5856:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e7d1 00000020:00010000:0.0:1787548778.242985:0:5856:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8feb81b65800: total 0 00000100:00080000:0.0:1787548778.242991:0:5856:0:(import.c:65:import_set_state_nolock()) ffff8fec905d5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787548778.243118:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1787548778.243676:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4505aba-b49a-4ae4-be2d-9f5ba513779c+21:2350:x1874380416194816:12345-192.168.206.13@tcp:39:umount.0 Request processed in 761us (1944us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787548778.243963:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 240 00000020:00010000:1.0:1787548778.245334:0:8451:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8feb81b65800: total 0 00010000:00010000:1.0:1787548778.245430:0:8451:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8feb81b65800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787548778.245499:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:1.0:1787548778.245504:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787548778.245517:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93800/0xcb7c48919424edf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a22fa expref: 20 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548778.245541:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fec90d93100) 00010000:00010000:1.0:1787548778.245543:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787548778.245548:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92200/0xcb7c48919424ea9b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a220c expref: 19 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548778.245573:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:1.0:1787548778.245576:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787548778.245581:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93200/0xcb7c48919424f496 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a24c8 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548778.245595:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fec90d93000) 00010000:00010000:1.0:1787548778.245598:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787548778.245602:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92000/0xcb7c48919424eb0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2228 expref: 17 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548778.245631:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:1.0:1787548778.245634:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787548778.245658:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93400/0xcb7c48919424f6b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2554 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548778.245675:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fec87ceb000) 00010000:00010000:1.0:1787548778.245678:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787548778.245682:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecc21ede00/0xcb7c48919424f1b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23f6 expref: 15 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548778.245702:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:1.0:1787548778.245705:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787548778.245709:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e000/0xcb7c48919424f01a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2386 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548778.245722:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8feca2d51a00) 00010000:00010000:1.0:1787548778.245725:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548778.245743:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22f200/0xcb7c48919424eab7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2213 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548778.245762:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:1.0:1787548778.245765:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787548778.245769:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92600/0xcb7c48919424f0fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23be expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548778.245781:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fec87cebd00) 00010000:00010000:1.0:1787548778.245784:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787548778.245787:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc93600/0xcb7c48919424f124 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23cc expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548778.245804:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:1.0:1787548778.245814:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787548778.245819:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6000/0xcb7c48919424f798 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a258c expref: 10 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548778.245836:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2d51600) 00010000:00010000:1.0:1787548778.246012:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787548778.246020:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbd22e400/0xcb7c48919424f19b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a23ef expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548778.246037:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fec90d93d00) 00010000:00010000:1.0:1787548778.246040:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787548778.246043:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6200/0xcb7c48919424f7c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a259a expref: 8 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548778.246057:0:8451:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8feb81b65800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787548778.246075:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548778.246077:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548778.246080:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548778.947497:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787548779.087188:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000020:00000080:3.0:1787548779.087204:0:6716:0:(genops.c:885:class_export_put()) final put ffff8fec83669800/e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000020:00000080:0.0:1787548779.087258:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fec83669800/e4505aba-b49a-4ae4-be2d-9f5ba513779c for lustre-OST0000 00000020:00000080:0.0:1787548779.087327:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fec8366e800 for lustre-OST0000 00000100:00100000:2.0:1787548779.578007:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548779.578057:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548779.578195:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416194944 00000100:00100000:3.0:1787548779.578214:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416194944 00000100:00100000:3.0:1787548779.578291:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 298 00000100:00100000:3.0:1787548779.578306:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2354:x1874380416194944:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548779.578316:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416195072 00000100:00100000:0.0:1787548779.578329:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416195072 00000100:00100000:0.0:1787548779.578420:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 162 00000100:00100000:3.0:1787548779.578432:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2354:x1874380416194944:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 126us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548779.578438:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92088e20-066b-499e-ac52-ab10992c506a+6:2354:x1874380416195072:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548779.578477:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 298 00000100:00100000:0.0:1787548779.578528:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92088e20-066b-499e-ac52-ab10992c506a+6:2354:x1874380416195072:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 93us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548779.578537:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 162 00000100:00080000:2.0:1787548779.580769:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787548779.971287:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548780.955928:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548780.956008:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548780.959934:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416195200 00000100:00100000:0.0:1787548780.959950:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416195200 00000100:00100000:3.0:1787548780.960013:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548780.960023:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416195456 00000100:00100000:0.0:1787548780.960026:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416195456 00000100:00100000:3.0:1787548780.960036:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416195328 00000100:00100000:3.0:1787548780.960039:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416195328 00000100:00100000:3.0:1787548780.960059:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 21 00000100:00100000:0.0:1787548780.960064:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 22 00000100:00100000:3.0:1787548780.960067:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:450a7108-39f6-4004-8f60-5d2336e0cad2+12:2354:x1874380416195200:12345-192.168.206.13@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787548780.960070:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:450a7108-39f6-4004-8f60-5d2336e0cad2+12:2354:x1874380416195328:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548780.960082:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548780.960082:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548780.960099:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec80030000/0xcb7c48919424e8a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2148 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548780.960109:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec90151c00/0xcb7c48919424e8aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2172 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548780.960118:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787548780.960118:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548780.960198:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:450a7108-39f6-4004-8f60-5d2336e0cad2+10:2354:x1874380416195328:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 127us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548780.960205:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 22 00000100:00100000:1.0:1787548780.960214:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 23 00000100:00100000:1.0:1787548780.960223:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:450a7108-39f6-4004-8f60-5d2336e0cad2+9:2354:x1874380416195456:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548780.960232:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548780.960242:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424ea6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a21f7 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548780.960251:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548780.960281:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:450a7108-39f6-4004-8f60-5d2336e0cad2+8:2354:x1874380416195456:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 60us (4273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548780.960296:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 23 00000100:00100000:3.0:1787548780.961421:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:450a7108-39f6-4004-8f60-5d2336e0cad2+7:2354:x1874380416195200:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 1347us (5591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548780.961440:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 21 00000100:00100000:0.0:1787548780.972077:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548780.972172:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416195712 00000100:00100000:2.0:1787548780.972182:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416195712 00000100:00100000:2.0:1787548780.972238:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 241 00000100:00100000:2.0:1787548780.972249:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+6:2350:x1874380416195712:12345-192.168.206.13@tcp:39:umount.0 00000020:00000080:2.0:1787548780.972296:0:5855:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e8b8 00000020:00010000:2.0:1787548780.972306:0:5855:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8fecbd0b3000: total 0 00000100:00080000:2.0:1787548780.972310:0:5855:0:(import.c:65:import_set_state_nolock()) ffff8feb81f22800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787548780.972333:0:5855:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1787548780.972562:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92088e20-066b-499e-ac52-ab10992c506a+5:2350:x1874380416195712:12345-192.168.206.13@tcp:39:umount.0 Request processed in 314us (494us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787548780.972570:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 241 00000020:00010000:3.0:1787548780.973118:0:8452:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8fecbd0b3000: total 0 00010000:00010000:3.0:1787548780.973189:0:8452:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fecbd0b3000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787548780.973222:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2d51600) 00010000:00010000:3.0:1787548780.973226:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787548780.973233:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec813f6c00/0xcb7c48919424f7e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25a8 expref: 4 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548780.973253:0:8452:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fecbd0b3000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787548780.973278:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548780.973280:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548780.973294:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548780.995479:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548781.002231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548781.002310:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416195968 00000100:00100000:0.0:1787548781.002319:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416195968 00000100:00100000:0.0:1787548781.002374:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 299 00000100:00100000:0.0:1787548781.002383:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+7:2350:x1874380416195968:12345-192.168.206.13@tcp:251:umount.0 00000020:00000080:0.0:1787548781.002424:0:5849:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e7ae 00000020:00010000:0.0:1787548781.002453:0:5849:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8fecaf319800: total 0 00000100:00080000:0.0:1787548781.002458:0:5849:0:(import.c:65:import_set_state_nolock()) ffff8fecaf31b800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787548781.002528:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:450a7108-39f6-4004-8f60-5d2336e0cad2+3:2350:x1874380416195968:12345-192.168.206.13@tcp:251:umount.0 Request processed in 146us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548781.002536:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 299 00000020:00010000:1.0:1787548781.002635:0:5843:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8fecaf319800: total 0 00010000:00010000:1.0:1787548781.002639:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548781.002681:0:5843:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fecaf319800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787548781.002711:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec90151800/0xcb7c48919424e802 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a213a expref: 2 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548781.002724:0:5843:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fecaf319800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787548781.002733:0:5843:0:(genops.c:885:class_export_put()) final put ffff8fecaf319800/450a7108-39f6-4004-8f60-5d2336e0cad2 00010000:00010000:1.0:1787548781.002751:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548781.002754:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548781.002755:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787548781.002789:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecaf319800/450a7108-39f6-4004-8f60-5d2336e0cad2 for MGS 00000020:00000080:0.0:1787548781.002836:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fecaf31b800 for MGS 00000100:00100000:0.0:1787548781.059398:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787548781.059421:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431898240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548781.059510:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548781.059740:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431898240 00000100:00100000:1.0:1787548781.059748:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431898240 00000100:00100000:1.0:1787548781.059796:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787548781.059804:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431898240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787548781.059850:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548781.059892:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431898240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548781.059898:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787548781.059923:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874380431898624:0@lo:400:kworker.0 00000100:00100000:1.0:1787548781.059952:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548781.059969:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787548781.059974:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431898496:0@lo:400:kworker.0 00000100:00100000:1.0:1787548781.059993:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548781.060187:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431898752:0@lo:400:kworker.0 00000100:00100000:3.0:1787548781.060217:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548781.060249:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787548781.060255:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431898368:0@lo:400:kworker.0 00000100:00100000:3.0:1787548781.060281:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548781.060302:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431898880:0@lo:400:kworker.0 00000100:00100000:3.0:1787548781.060323:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548781.060352:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431898368 00000100:00100000:3.0:1787548781.060356:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431898368 00000100:00100000:3.0:1787548781.060383:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787548781.060390:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431898368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548781.060424:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3313:x1874380431898368:12345-0@lo:400:kworker.0 Request processed in 35us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548781.060430:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787548781.060466:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431898624 00000100:00100000:3.0:1787548781.060470:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431898624 00000100:00100000:3.0:1787548781.060493:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431898496 00000100:00100000:3.0:1787548781.060496:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431898496 00000100:00100000:3.0:1787548781.060507:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431898880 00000100:00100000:3.0:1787548781.060509:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431898880 00000100:00100000:3.0:1787548781.060522:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787548781.060528:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874380431898624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548781.060564:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874380431898624:12345-0@lo:400:kworker.0 Request processed in 36us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548781.060569:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787548781.060581:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787548781.060587:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431898496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548781.060622:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431898496:12345-0@lo:400:kworker.0 Request processed in 35us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548781.060628:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787548781.060640:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787548781.060646:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431898880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548781.060670:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874380431898880:12345-0@lo:400:kworker.0 Request processed in 25us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548781.060676:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787548781.060708:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431898496:0@lo:400:kworker.0 00000100:00100000:3.0:1787548781.060717:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874380431898624:0@lo:400:kworker.0 00000100:00100000:3.0:1787548781.060741:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431898368:0@lo:400:kworker.0 00000100:00100000:3.0:1787548781.060749:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431898880:0@lo:400:kworker.0 00000100:00100000:3.0:1787548781.060774:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431898240:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787548781.061012:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787548781.061016:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787548781.061176:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787548781.061193:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431899008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548781.061223:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548781.061290:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431899008 00000100:00100000:2.0:1787548781.061295:0:11969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431899008 00000100:00100000:2.0:1787548781.061340:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787548781.061347:0:11969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431899008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787548781.061371:0:11969:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548781.061410:0:11969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431899008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548781.061416:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787548781.061474:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431899008:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787548781.061602:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548781.061648:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431898752 00000100:00100000:1.0:1787548781.061652:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431898752 00000100:00100000:1.0:1787548781.061685:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787548781.061692:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431898752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548781.061737:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431898752:12345-0@lo:400:kworker.0 Request processed in 46us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548781.061743:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787548781.061808:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431898752:0@lo:400:kworker.0 00000001:00100000:1.0:1787548781.636686:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000020:00000080:1.0:1787548781.636696:0:7647:0:(genops.c:885:class_export_put()) final put ffff8feb81f25000/e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000020:00000080:3.0:1787548781.636968:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8feb81f25000/e4505aba-b49a-4ae4-be2d-9f5ba513779c for lustre-OST0001 00000020:00000080:3.0:1787548781.637006:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fec8381a000 for lustre-OST0001 00000001:00100000:3.0:1787548781.641207:0:12481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000001:00080000:3.0:1787548781.641224:0:12481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:3.0:1787548781.641238:0:12481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 92088e20-066b-499e-ac52-ab10992c506a 00000001:00080000:3.0:1787548781.641244:0:12481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1787548781.641247:0:12481:0:(genops.c:885:class_export_put()) final put ffff8fecbd0b3000/92088e20-066b-499e-ac52-ab10992c506a 00000020:00000080:3.0:1787548781.641262:0:12481:0:(genops.c:885:class_export_put()) final put ffff8feb81b65800/e4505aba-b49a-4ae4-be2d-9f5ba513779c 00000020:00000080:3.0:1787548781.641397:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecbd0b3000/92088e20-066b-499e-ac52-ab10992c506a for lustre-MDT0000 00000020:00000080:3.0:1787548781.641440:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8feb81b65800/e4505aba-b49a-4ae4-be2d-9f5ba513779c for lustre-MDT0000 00000020:00000080:3.0:1787548781.641491:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8feb81f22800 for lustre-MDT0000 00000020:00000080:3.0:1787548781.641496:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fec905d5000 for lustre-MDT0000 00010000:00010000:3.0:1787548782.022577:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548783.043279:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787548783.194563:0:12976:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787548783.209983:0:12976:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787548783.210047:0:12976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.210066:0:12976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.210075:0:12976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.210084:0:12976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.210117:0:12976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787548783.210123:0:12976:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787548783.210182:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787548783.210188:0:12976:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787548783.210195:0:12976:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787548783.210226:0:12976:0:(import.c:65:import_set_state_nolock()) ffff8feca6f6a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787548783.210294:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874380431899136:0@lo:39:umount.0 00000100:00100000:0.0:1787548783.210390:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787548783.210592:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548783.210601:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548783.210624:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec81534800 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:2.0:1787548783.210628:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548783.210637:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787548783.210645:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548783.210650:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787548783.210653:0:8451:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787548783.210655:0:8451:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787548783.210687:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548783.210694:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787548783.210732:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548783.210748:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec81534800/0xcb7c48919424e841 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e848 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548783.210761:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548783.210763:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548783.210764:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548783.210773:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787548783.210782:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431899264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787548783.210820:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548783.210871:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431899264 00000100:00100000:2.0:1787548783.210879:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431899264 00000100:00100000:2.0:1787548783.210939:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787548783.210949:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecba12f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431899264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787548783.210965:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548783.210983:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21ec800/0xcb7c48919424e848 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424e841 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548783.210997:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548783.211034:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecba12f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3418829f-2e19-44b5-ae62-1256ac42dc62+18:3315:x1874380431899264:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548783.211042:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787548783.211116:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431899264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787548783.211178:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431899136 00000100:00100000:2.0:1787548783.211182:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431899136 00000100:00100000:2.0:1787548783.211213:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787548783.211220:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874380431899136:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787548783.211246:0:5854:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e5bd 00000100:00080000:2.0:1787548783.211256:0:5854:0:(import.c:65:import_set_state_nolock()) ffff8fecad2ba000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787548783.211331:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3312:x1874380431899136:12345-0@lo:39:umount.0 Request processed in 111us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548783.211339:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1787548783.211345:0:5854:0:(genops.c:885:class_export_put()) final put ffff8fecad2be000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787548783.211370:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787548783.211381:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecad2be000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787548783.211445:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fecad2ba000 for lustre-MDT0000 00000100:00080000:2.0:1787548783.211476:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8feca6f6a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787548783.211485:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874380431899136:0@lo:39:umount.0 00000100:00080000:0.0:1787548783.214384:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787548783.214393:0:12976:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787548783.214403:0:12976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787548783.215345:0:12976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215364:0:12976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215372:0:12976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215378:0:12976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215412:0:12976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787548783.215419:0:12976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215426:0:12976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215432:0:12976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215447:0:12976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215461:0:12976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787548783.215468:0:12976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215474:0:12976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215491:0:12976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215498:0:12976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215511:0:12976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787548783.215518:0:12976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534200/0xcb7c48919424e51c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215524:0:12976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534200/0xcb7c48919424e51c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215531:0:12976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534200/0xcb7c48919424e51c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215537:0:12976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.113@tcp lock: ffff8fec81534200/0xcb7c48919424e51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.215547:0:12976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787548783.215551:0:12976:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787548783.215584:0:12976:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787548783.215589:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787548783.215594:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787548783.215601:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787548783.215609:0:12976:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8fecacdec800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787548783.215615:0:12976:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8feb81197000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787548783.215620:0:12976:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8fecad893370) has exports, disconnecting them 00000020:00080000:0.0:1787548783.215631:0:12976:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8fecacdec800), last request at 1787548781 00000020:00000080:0.0:1787548783.215640:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e730 00000100:00080000:0.0:1787548783.215660:0:12976:0:(import.c:65:import_set_state_nolock()) ffff8fecacdea800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787548783.215721:0:12976:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fecacdec800): rc 0 00000020:00000080:0.0:1787548783.215723:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fecacdec800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787548783.215733:0:12976:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8feb81197000), last request at 1787548781 00000020:00000080:0.0:1787548783.215736:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e657 00000100:00080000:0.0:1787548783.215742:0:12976:0:(import.c:65:import_set_state_nolock()) ffff8feb81196800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787548783.215749:0:12976:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8feb81197000): rc 0 00000020:00000080:0.0:1787548783.215751:0:12976:0:(genops.c:885:class_export_put()) final put ffff8feb81197000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787548783.215758:0:12976:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb77042c1fae0 00000100:00080000:0.0:1787548783.215781:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787548783.215785:0:12976:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787548783.215797:0:12976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787548783.215857:0:12976:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787548783.215882:0:12976:0:(import.c:65:import_set_state_nolock()) ffff8fecad8a0800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787548783.215900:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787548783.215902:0:12976:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787548783.215919:0:12976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787548783.215975:0:12976:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787548783.215984:0:12976:0:(import.c:65:import_set_state_nolock()) ffff8feb81193000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787548783.216015:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8fecad893370) has no exports 00000020:00000080:2.0:1787548783.217271:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecacdec800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1787548783.217494:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787548783.217509:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.217522:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22ee00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:3.0:1787548783.217527:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.217536:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787548783.217543:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548783.217549:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787548783.217552:0:5842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1787548783.217555:0:5842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1787548783.217671:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.217678:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787548783.217794:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.217802:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ee00/0xcb7c48919424e84f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.217837:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787548783.217840:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.217847:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6e00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:3.0:1787548783.217850:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.217856:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787548783.217862:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548783.217866:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787548783.217869:0:5842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787548783.217871:0:5842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787548783.217887:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.217893:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787548783.217899:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.217906:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec813f6e00/0xcb7c48919424e768 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e76f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.217918:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787548783.217922:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.217932:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f400 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:3.0:1787548783.217936:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.217943:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787548783.217949:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548783.217954:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787548783.217956:0:5842:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787548783.217958:0:5842:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787548783.217968:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.217973:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787548783.217989:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.217996:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecbd22f400/0xcb7c48919424ea5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424ea63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.218009:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548783.218014:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec81534200/0xcb7c48919424e51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787548783.218020:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8feb81197000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:3.0:1787548783.218021:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec81534200 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:3.0:1787548783.218029:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec81534200/0xcb7c48919424e51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.218042:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec81534200/0xcb7c48919424e51c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787548783.218049:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec81534200/0xcb7c48919424e51c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548783.218056:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787548783.218059:0:5842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787548783.218062:0:5842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:2.0:1787548783.218069:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fecacdea800 for lustre-MDT0000 00010000:00010000:3.0:1787548783.218079:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec81534200/0xcb7c48919424e51c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787548783.218080:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8feb81196800 for lustre-MDT0000 00010000:00010000:3.0:1787548783.218092:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787548783.218099:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec81534200/0xcb7c48919424e51c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548783.218105:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548783.218106:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec81534200/0xcb7c48919424e51c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.218127:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548783.218156:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548783.218159:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548783.218168:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548783.218171:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431899904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787548783.218255:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431899648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787548783.218272:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548783.219352:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787548783.219367:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431900032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787548783.219420:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548783.219478:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431899904 00000100:00100000:2.0:1787548783.219489:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431899904 00000100:00100000:2.0:1787548783.219548:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431900032 00000100:00100000:2.0:1787548783.219552:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431900032 00000100:00100000:2.0:1787548783.219575:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787548783.219586:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+19:3315:x1874380431899904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787548783.219603:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548783.219625:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecbcc93000/0xcb7c48919424ea63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424ea5c expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548783.219644:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548783.219687:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+18:3315:x1874380431899904:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548783.219706:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787548783.219724:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787548783.219730:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+17:3315:x1874380431900032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787548783.219934:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548783.219958:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21ec600/0xcb7c48919424e523 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424e51c expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548783.219974:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548783.220001:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3418829f-2e19-44b5-ae62-1256ac42dc62+16:3315:x1874380431900032:12345-0@lo:103:ldlm_bl.0 Request processed in 272us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548783.220009:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787548783.220051:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431900032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787548783.220062:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3418829f-2e19-44b5-ae62-1256ac42dc62:3315:1874380431899904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787548783.220091:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548783.220111:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431899392:0@lo:9:umount.0 00000100:00100000:0.0:1787548783.220196:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431899776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787548783.220229:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548783.220261:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431899776 00000100:00100000:0.0:1787548783.220264:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431899776 00000100:00100000:0.0:1787548783.220295:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787548783.220301:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3418829f-2e19-44b5-ae62-1256ac42dc62+16:3314:x1874380431899776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787548783.220336:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548783.220347:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec813f6a00/0xcb7c48919424e76f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424e768 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548783.220361:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548783.220389:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3418829f-2e19-44b5-ae62-1256ac42dc62+15:3314:x1874380431899776:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548783.220395:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787548783.220420:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431899776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787548783.220671:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548783.220705:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431899520:0@lo:9:umount.0 00000100:00100000:2.0:1787548783.220729:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548783.222298:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431899392 00000100:00100000:0.0:1787548783.222329:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431899392 00000100:00100000:0.0:1787548783.222408:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431899520 00000100:00100000:0.0:1787548783.222411:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431899520 00000100:00100000:0.0:1787548783.222453:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787548783.222465:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874380431899392:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787548783.222501:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e6a4 00000100:00080000:0.0:1787548783.222512:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8fecbcb62000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787548783.222558:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787548783.222760:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548783.222843:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431899648 00000100:00100000:3.0:1787548783.222851:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431899648 00000100:00100000:3.0:1787548783.222899:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787548783.222907:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad561c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+15:3313:x1874380431899648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787548783.222931:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548783.222947:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec81534000/0xcb7c48919424e856 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424e84f expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.222963:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548783.223001:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad561c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3418829f-2e19-44b5-ae62-1256ac42dc62+14:3313:x1874380431899648:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548783.223009:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787548783.223058:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3418829f-2e19-44b5-ae62-1256ac42dc62:3313:1874380431899648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787548783.223375:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3312:x1874380431899392:12345-0@lo:9:umount.0 Request processed in 909us (2699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548783.223386:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787548783.223408:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787548783.223418:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874380431899520:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787548783.223447:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e7a7 00000100:00080000:0.0:1787548783.223455:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8fecb7dbf000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787548783.223485:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787548783.223949:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3312:x1874380431899520:12345-0@lo:9:umount.0 Request processed in 531us (3217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548783.223970:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787548783.224014:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787548783.224019:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787548783.224037:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548783.224045:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787548783.224085:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fecad8a0800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787548783.224102:0:3312:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787548783.224105:0:3312:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787548783.224109:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431899392:0@lo:9:umount.0 00000100:00080000:0.0:1787548783.224125:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8feb81193000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787548783.224159:0:3312:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787548783.224160:0:3312:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787548783.224164:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431899520:0@lo:9:umount.0 00000020:00080000:1.0:1787548783.247653:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8fecad893370) has no exports 00000020:00000080:1.0:1787548783.356969:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e577 00000020:00000080:1.0:1787548783.356985:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fecb3417000/lustre-QMT0000_UUID 00000020:01000000:1.0:1787548783.357073:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787548783.357253:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787548783.357272:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787548783.357279:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8fec86114d28) has no exports 00000020:00000080:0.0:1787548783.357749:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e570 00000020:00000080:0.0:1787548783.357760:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fecb5094000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787548783.360686:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecb3417000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787548783.361926:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecb5094000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787548783.362013:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787548783.362028:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787548783.362034:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fecb5097800/lustre-QMT0000_UUID 00000020:00000080:3.0:1787548783.362038:0:12976:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecb5097800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787548783.362043:0:12976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1787548783.362263:0:12976:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fec86182ae0 - data ffff8fecb83245e8/ffff8fecaf33b000 00000020:01000000:3.0:1787548783.362430:0:12976:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fec86492d20 - data ffff8fecb83adaf8/ffff8fecad3b4000 00000001:00000004:2.0:1787548783.377893:0:12976:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787548783.485718:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787548783.485727:0:12976:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787548783.485742:0:12976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787548783.485745:0:12976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787548783.487943:0:6721:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787548783.487951:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1787548783.487965:0:6721:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787548783.489574:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787548783.489580:0:12976:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787548783.489633:0:12976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787548783.489636:0:12976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787548783.491193:0:8094:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787548783.491198:0:8094:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1787548783.491208:0:8094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787548783.592318:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e53f 00000020:00000080:0.0:1787548783.592330:0:12976:0:(genops.c:885:class_export_put()) final put ffff8feca6f7d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787548783.593352:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8feca6f7d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787548783.594620:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e554 00000020:00000080:0.0:1787548783.594631:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fecad8a4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787548783.594661:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787548783.594667:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787548783.594676:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787548783.594680:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8fec87eacd28) has no exports 00000004:01000000:0.0:1787548783.594840:0:12976:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787548783.594850:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e792 00000020:00000080:0.0:1787548783.594854:0:12976:0:(genops.c:885:class_export_put()) final put ffff8feb81b64800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787548783.594858:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787548783.594861:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787548783.594867:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787548783.594870:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8fec882ecd28) has no exports 00000020:00000080:0.0:1787548783.594876:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e78b 00000020:00000080:0.0:1787548783.594879:0:12976:0:(genops.c:885:class_export_put()) final put ffff8feb81195800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787548783.595211:0:12976:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787548783.595216:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787548783.595219:0:12976:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1787548783.595224:0:12976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787548783.595226:0:12976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787548783.595273:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787548783.595280:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787548783.595285:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e69d 00000020:00000080:0.0:1787548783.595290:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fecaf31b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787548783.595293:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787548783.595296:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787548783.595300:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787548783.595302:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8feb811ecd28) has no exports 00000020:00000080:0.0:1787548783.595305:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e696 00000020:00000080:0.0:1787548783.595308:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fecad8a1800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787548783.595581:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecad8a4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1787548783.595590:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8feb81b64800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787548783.595594:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8feb81195800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787548783.595600:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8feb81193000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787548783.595605:0:38:0:(genops.c:885:class_export_put()) final put ffff8fecbcb65000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787548783.595607:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecbcb65000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787548783.595619:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787548783.595683:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecaf31b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787548783.595688:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecad8a1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787548783.596193:0:12976:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787548783.596198:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787548783.596201:0:12976:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787548783.596206:0:12976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787548783.596213:0:12976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787548783.596264:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787548783.596271:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787548783.596300:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787548783.596303:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787548783.596306:0:12976:0:(genops.c:885:class_export_put()) final put ffff8feca6f7e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787548783.596309:0:12976:0:(genops.c:844:class_export_destroy()) destroying export ffff8feca6f7e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787548783.596313:0:12976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787548783.596448:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e55b 00000020:00000080:0.0:1787548783.596454:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fecad8a3000/lustre-MDD0000_UUID 00000020:01000000:0.0:1787548783.596458:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787548783.596462:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787548783.596465:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787548783.596468:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8fecad8919b8) has no exports 00000020:00000080:0.0:1787548783.596563:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787548783.596567:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787548783.596571:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e562 00000020:00000080:0.0:1787548783.596575:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fecad8a3800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787548783.596582:0:12976:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fec8644c800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787548783.596585:0:12976:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fec8644c800 3 00000020:01000004:0.0:1787548783.596588:0:12976:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fec8644c800 from lustre-MDT0000 00000020:00000080:0.0:1787548783.596605:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787548783.596608:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787548783.596610:0:12976:0:(genops.c:885:class_export_put()) final put ffff8feca6f7a000/lustre-MDT0000_UUID 00000020:00000080:3.0:1787548783.596930:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fecad8a0800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787548783.596937:0:38:0:(genops.c:885:class_export_put()) final put ffff8fecaf318800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787548783.596939:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecaf318800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787548783.596945:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787548783.597020:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecad8a3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787548783.597024:0:38:0:(genops.c:885:class_export_put()) final put ffff8feca6f7b000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787548783.597026:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8feca6f7b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787548783.597029:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787548783.597170:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecad8a3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787548783.597937:0:12976:0:(genops.c:844:class_export_destroy()) destroying export ffff8feca6f7a000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787548783.597945:0:12976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787548783.597983:0:12976:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787548783.597988:0:12976:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787548783.597993:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787548783.597996:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787548783.598000:0:12976:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787548783.598006:0:12976:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8fec8381f800 3418829f-2e19-44b5-ae62-1256ac42dc62 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787548783.598012:0:12976:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8fec861119b8) has exports, disconnecting them 00000020:00080000:0.0:1787548783.598024:0:12976:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8fec8381f800), last request at 1787548571 00000020:00000080:0.0:1787548783.598037:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e500 00000020:00010000:0.0:1787548783.598041:0:12976:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8fec8381f800: total 0 00000100:00080000:0.0:1787548783.598045:0:12976:0:(import.c:65:import_set_state_nolock()) ffff8fec8381c800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787548783.598054:0:12976:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fec8381f800): rc 0 00000020:00080000:0.0:1787548783.598058:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8fec861119b8) has no exports 00000100:00100000:0.0:1787548783.598117:0:5849:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8fec865e3000:5849] 2 exiting: rc = 0 00000100:00100000:1.0:1787548783.598186:0:5846:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8fec8844c000:5846] 0 exiting: rc = 1 00000020:00010000:3.0:1787548783.598956:0:8452:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8fec8381f800: total 0 00010000:00010000:3.0:1787548783.598991:0:8452:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fec8381f800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787548783.599017:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec90150a00/0xcb7c48919424e810 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424e809 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.599033:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec90151e00/0xcb7c48919424e81e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424e817 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.599043:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecbd22e200/0xcb7c48919424e83a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424e833 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.599053:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21ed000/0xcb7c48919424ea47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424ea40 expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.599062:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21ece00/0xcb7c48919424e82c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424e825 expref: 5 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.599087:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec813f7a00/0xcb7c48919424e60a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424e603 expref: 4 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.599100:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecbd22f800/0xcb7c48919424ea55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424ea4e expref: 3 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.599112:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec81534c00/0xcb7c48919424e864 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb7c48919424e85d expref: 2 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548783.599122:0:8452:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fec8381f800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787548783.599156:0:8452:0:(genops.c:885:class_export_put()) final put ffff8fec8381f800/3418829f-2e19-44b5-ae62-1256ac42dc62 00010000:00010000:3.0:1787548783.599171:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548783.599173:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548783.599175:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548783.599198:0:5848:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8fec8844da00:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1787548783.600001:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600009:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600015:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600022:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600029:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600036:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600042:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600049:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600055:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600062:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600068:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600075:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600082:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600087:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600093:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600110:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600117:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600124:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600144:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600152:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600158:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600164:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600171:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600177:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600183:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600189:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600194:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600200:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600206:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600212:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600218:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600224:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600230:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600236:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600242:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600246:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600250:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600256:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600261:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600266:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600270:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600276:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600281:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600286:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600291:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600297:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600302:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600307:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600312:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600317:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600329:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600334:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600340:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600344:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600349:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600354:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600360:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600365:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787548783.600365:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fec8381f800/3418829f-2e19-44b5-ae62-1256ac42dc62 for MGS 00000100:00100000:1.0:1787548783.600369:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600374:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600379:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600384:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600389:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.600395:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787548783.600402:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fec8381c800 for MGS 20000000:01000000:1.0:1787548783.600743:0:12976:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787548783.600747:0:12976:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1787548783.603710:0:12976:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fec86182540 - data ffff8fecb832d6c0/ffff8fecaf338000 00000020:01000000:1.0:1787548783.603817:0:12976:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fec86be0ae0 - data ffff8fec9f81e288/ffff8fec83e6a000 00000020:00000080:1.0:1787548783.604274:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e4e4 00000020:00000080:1.0:1787548783.604282:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fec90653800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787548783.604302:0:12976:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fec8644c800 from MGS, refs=2 00000020:01000004:1.0:1787548783.604306:0:12976:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fec8644c800 2 00000020:01000004:1.0:1787548783.604309:0:12976:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fec8644c800 from MGS 00000020:00000080:3.0:1787548783.604321:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fec90653800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787548783.604329:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787548783.604335:0:12976:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787548783.604337:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fec90654800/MGS 00000020:00000080:1.0:1787548783.604339:0:12976:0:(genops.c:844:class_export_destroy()) destroying export ffff8fec90654800/MGS for MGS 00000020:01000000:1.0:1787548783.604344:0:12976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787548783.604395:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787548783.604399:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787548783.604404:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787548783.604410:0:12976:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8fecb3db1800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787548783.604416:0:12976:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8fec882eb370) has exports, disconnecting them 00000020:00080000:1.0:1787548783.604448:0:12976:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8fecb3db1800), last request at 1787548571 00000020:00000080:1.0:1787548783.604453:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e5af 00000020:00080000:1.0:1787548783.604459:0:12976:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fecb3db1800): rc 0 00000020:00000080:1.0:1787548783.604464:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fecb3db1800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787548783.604552:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecb3db1800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787548783.605006:0:12976:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787548783.605011:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787548783.605014:0:12976:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787548783.605020:0:12976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787548783.605170:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787548783.605175:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787548783.605178:0:12976:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fec8644c800 1 00000020:00000080:1.0:1787548783.605183:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e4d6 00000020:00000080:1.0:1787548783.605187:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fec90657800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787548783.605191:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787548783.605194:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8feca6f6a000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787548783.605195:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787548783.605198:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787548783.605200:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8fec87ea8000) has no exports 00000020:00000080:3.0:1787548783.605201:0:37:0:(genops.c:885:class_export_put()) final put ffff8fecad2bb000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787548783.605203:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecad2bb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787548783.605206:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787548783.605323:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fec90657800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787548783.704695:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787548783.704711:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787548783.704716:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fec86449800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787548783.704721:0:12976:0:(genops.c:844:class_export_destroy()) destroying export ffff8fec86449800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787548783.704730:0:12976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787548783.704866:0:12976:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8fec8644d000 00000020:01000000:0.0:1787548783.704886:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787548783.704890:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787548783.704895:0:12976:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787548783.704898:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8fec87ea99b8) has no exports 00000100:00100000:3.0:1787548783.706311:0:8467:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8fec8601cc00:8467] 3 exiting: rc = 0 00000100:00100000:2.0:1787548783.708379:0:5855:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8fec836ea600:5855] 1 exiting: rc = 0 00000100:00100000:2.0:1787548783.708615:0:5854:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8fec836ea400:5854] 0 exiting: rc = 1 00000100:00100000:2.0:1787548783.708672:0:5856:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8fec836ea200:5856] 2 exiting: rc = 0 00000100:00100000:0.0:1787548783.709046:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709054:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709059:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709065:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709070:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709076:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709081:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709085:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709090:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709094:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709100:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709105:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709111:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709148:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709155:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709161:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709166:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709170:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709176:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709181:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709186:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709192:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709197:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709202:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709207:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709213:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709219:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709382:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709393:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709398:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709403:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709407:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709412:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709417:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709443:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709450:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709456:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709461:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709466:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709472:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.709477:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.710462:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.710475:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.710482:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.710487:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.710492:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.710496:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.710502:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.710519:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.710525:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.710531:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.710536:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.711692:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.711706:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.711712:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.711717:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.711722:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.711728:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.711733:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.711738:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.711744:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.711749:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.711754:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.711780:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.727942:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8feca70b1c00:5858] 1 exiting: rc = 0 00000100:00100000:1.0:1787548783.729218:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8fec8844d600:5857] 0 exiting: rc = 1 00000100:00100000:3.0:1787548783.732642:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732655:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732661:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732667:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732689:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732696:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732703:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732709:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732715:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732720:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732726:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732733:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732739:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732744:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732749:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732754:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732758:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732763:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732768:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732772:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732778:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732782:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732786:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732791:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732797:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732802:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732807:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732813:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732818:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732824:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732830:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732835:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732839:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732843:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732849:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732853:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732858:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732862:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732867:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732879:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732883:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732888:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732893:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732898:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732903:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732907:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732913:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732919:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732924:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732929:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732934:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732940:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732945:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732950:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732955:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732960:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732964:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732969:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732974:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732979:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732983:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732988:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732992:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.732998:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.733532:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8feca70b1a00:5860] 0 exiting: rc = 1 00000100:00100000:0.0:1787548783.733710:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8feca70b1200:5861] 1 exiting: rc = 0 00000100:00100000:3.0:1787548783.734185:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734201:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734210:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734216:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734222:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734237:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734243:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734248:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734253:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734258:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734275:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734281:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734287:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734293:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734313:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734321:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734328:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734333:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734339:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734346:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734351:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734357:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734363:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734370:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734376:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734383:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734403:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734411:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734418:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734425:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734431:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734448:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734453:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734459:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734465:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734471:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734609:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734615:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734636:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734643:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734648:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734654:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734660:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734666:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734671:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734684:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734689:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734694:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734699:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734707:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734727:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734734:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734743:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734749:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734756:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734761:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734767:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734772:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734778:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734785:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734790:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734795:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734801:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.734814:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.749546:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8fec865e2800:5863] 1 exiting: rc = 0 00000100:00100000:1.0:1787548783.750727:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8fec865e3a00:5862] 0 exiting: rc = 1 00000100:00100000:0.0:1787548783.752337:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752348:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752353:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752358:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752363:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752368:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752743:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752748:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752752:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752757:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752761:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752766:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752770:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752779:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752784:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752788:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752792:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752806:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752810:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752814:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752819:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752823:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752828:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752832:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752836:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752841:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752845:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752849:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752853:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752857:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752861:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752866:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752870:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752874:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752879:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752883:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752888:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752893:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752897:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752901:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752905:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752909:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752914:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752923:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752930:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752935:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752941:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752946:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752951:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.752956:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.753076:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.753083:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.753097:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.753102:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.753106:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.753111:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.753115:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.753119:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.753123:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.753153:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.753159:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.753164:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.753169:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548783.753175:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754633:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8fec865e2200:5865] 1 exiting: rc = 0 00000100:00100000:1.0:1787548783.754692:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8fec865e3c00:5864] 0 exiting: rc = 1 00000100:00100000:3.0:1787548783.754731:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754738:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754743:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754748:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754753:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754759:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754764:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754768:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754774:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754779:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754784:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754789:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754794:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754798:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754803:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754821:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754826:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754831:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754835:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754840:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754845:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754850:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754854:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754860:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754865:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754870:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754875:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754880:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754890:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754895:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754900:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754905:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754909:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754913:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754918:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754923:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754927:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754931:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754936:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754940:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754945:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754949:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754954:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754958:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754963:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754967:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754972:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754977:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754981:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754985:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.754996:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755000:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755005:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755009:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755013:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755018:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755022:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755027:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755031:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755035:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755039:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755044:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755048:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755052:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.755716:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8fec865e2400:5866] 0 exiting: rc = 1 00000100:00100000:0.0:1787548783.755793:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8fec865e3200:5867] 1 exiting: rc = 0 00000100:00100000:3.0:1787548783.755920:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755926:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755931:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755936:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755941:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755946:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755950:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755954:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755959:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755963:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755968:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755972:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755977:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755981:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755985:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755990:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755994:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.755998:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756003:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756007:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756012:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756024:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756029:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756034:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756039:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756044:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756049:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756054:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756058:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756063:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756068:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756072:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756077:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756081:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756085:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756089:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756094:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756098:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756102:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756106:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756110:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756114:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756118:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.756125:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758599:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758611:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758616:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758621:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758626:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758632:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758637:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758642:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758648:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758653:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758659:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758664:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758686:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758692:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758698:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758704:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758709:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758715:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758719:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.758725:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548783.763592:0:5870:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8fec850e6200:5870] 2 exiting: rc = 0 00000100:00100000:1.0:1787548783.763842:0:5868:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8fec850e6400:5868] 0 exiting: rc = 1 00000100:00100000:0.0:1787548783.764411:0:5869:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8fec850e6600:5869] 1 exiting: rc = 0 00000100:00100000:3.0:1787548783.766589:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766599:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766605:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766635:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766642:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766649:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766654:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766659:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766665:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766670:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766675:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766681:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766686:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766692:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766698:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766704:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766709:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766715:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766721:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766727:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766733:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.766739:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769464:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769471:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769721:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769727:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769731:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769766:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769772:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769777:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769782:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769787:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769792:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769797:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769803:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769808:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769814:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769820:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769830:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769836:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769842:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769848:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769934:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769943:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769948:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769953:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769957:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769963:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769968:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769973:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769978:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.769995:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.770001:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.770005:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.770010:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.770015:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.770019:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.770025:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.770030:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.770036:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.770042:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.770047:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.770060:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787548783.770076:0:12976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787548783.778737:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787548783.778748:0:12976:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787548783.778754:0:12976:0:(genops.c:885:class_export_put()) final put ffff8fec83799000/MDS_uuid 00000020:00000080:3.0:1787548783.778759:0:12976:0:(genops.c:844:class_export_destroy()) destroying export ffff8fec83799000/MDS_uuid for MDS 00000020:01000000:3.0:1787548783.778764:0:12976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787548783.778884:0:12976:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787548784.067342:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787548784.188294:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787548784.188303:0:6716:0:(genops.c:885:class_export_put()) final put ffff8fecace6e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787548784.191166:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecace6e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787548784.191228:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fecbcb62000 for lustre-OST0000 00010000:00010000:0.0:1787548785.092616:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548786.119211:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548786.179671:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431900288:0@lo:400:kworker.0 00000400:00000100:0.0:1787548786.179732:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874380431900288 offset 0 length 224: 4 00000100:00100000:0.0:1787548786.179793:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787548786.179799:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431900160:0@lo:400:kworker.0 00000400:00000100:0.0:1787548786.179820:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874380431900160 offset 0 length 224: 4 00000100:00100000:0.0:1787548786.179841:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787548786.179848:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431900416:0@lo:400:kworker.0 00000400:00000100:0.0:1787548786.179866:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874380431900416 offset 0 length 224: 4 00000020:01000004:3.0:1787548786.695920:0:13128:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787548786.723262:0:13128:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787548786.723306:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548786.723331:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548786.723339:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548786.723346:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548786.723371:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787548786.723377:0:13128:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787548786.723403:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787548786.723413:0:13128:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fec8833fb80 x1874380431900288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548802 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548786.723441:0:13128:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1787548786.723477:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431900288:0@lo:400:kworker.0 00000100:00080000:3.0:1787548786.723502:0:13128:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787548786.723523:0:13128:0:(import.c:65:import_set_state_nolock()) ffff8fecb3412800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787548786.723601:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548786.723608:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548786.723626:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151200 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:0.0:1787548786.723629:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548786.723638:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787548786.723644:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548786.723650:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787548786.723652:0:8452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787548786.723654:0:8452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787548786.723678:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548786.723685:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787548786.723717:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548786.723724:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec90151200/0xcb7c48919424e825 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb7c48919424e82c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548786.723736:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548786.723737:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548786.723739:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548786.723753:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431900672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787548786.723809:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548786.723864:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431900672 00000100:00100000:0.0:1787548786.723877:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431900672 00000100:00100000:0.0:1787548786.723910:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787548786.723917:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3316:x1874380431900672:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787548786.723923:0:5841:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787548786 with bad export cookie 14662674276904396032 00000100:00100000:2.0:1787548786.726520:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1874380431900544:0@lo:39:umount.0 00000400:00000100:2.0:1787548786.726592:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874380431900544 offset 0 length 224: 4 00000100:00100000:2.0:1787548786.744851:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3316:x1874380431900672:12345-0@lo:103:ldlm_bl.0 Request processed in 20924us (21032us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787548786.744867:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787548786.745490:0:3316:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787548786.745496:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8fec88664000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787548786.745500:0:3316:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.113@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1787548786.759678:0:3316:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.113@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787548786.759684:0:3316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787548786.759694:0:3316:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fec8833ca80 x1874380431900160/t0(0) o400->MGC192.168.206.113@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787548802 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548786.759714:0:3316:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fecb51cdf80 x1874380431900672/t0(0) o103->MGC192.168.206.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787548802 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787548786.759724:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787548786.759727:0:3316:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787548786.759728:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787548786.759732:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8fec88664000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787548786.759736:0:3316:0:(import.c:510:import_select_connection()) MGC192.168.206.113@tcp: connect to NID 0@lo last attempt 193 00000100:00080000:0.0:1787548786.759744:0:3316:0:(import.c:624:import_select_connection()) MGC192.168.206.113@tcp: import ffff8fec88664000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:0.0:1787548786.759777:0:3316:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecb51cdc00 x1874380431900800/t0(0) o250->MGC192.168.206.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787548786.759814:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3418829f-2e19-44b5-ae62-1256ac42dc62:3316:1874380431900672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787548786.759845:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3418829f-2e19-44b5-ae62-1256ac42dc62:3312:1874380431900800:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1787548786.759891:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874380431900800 offset 0 length 520: 4 00000100:00100000:3.0:1787548786.760080:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3418829f-2e19-44b5-ae62-1256ac42dc62:3314:1874380431900160:0@lo:400:kworker.0 00000001:00100000:3.0:1787548786.760532:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787548786.760537:0:7647:0:(genops.c:885:class_export_put()) final put ffff8fecb7dba800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787548786.761151:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecb7dba800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787548786.761197:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fecb7dbf000 for lustre-OST0001 00010000:00010000:2.0:1787548787.139361:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548788.163982:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548789.187367:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548790.211479:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548791.235292:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787548791.299664:0:12905:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3418829f-2e19-44b5-ae62-1256ac42dc62->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787548791.299673:0:12905:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3418829f-2e19-44b5-ae62-1256ac42dc62->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787548791.300277:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431900928:0@lo:400:kworker.0 00000400:00000100:3.0:1787548791.300334:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874380431900928 offset 0 length 224: 4 00010000:00010000:0.0:1787548792.260509:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548793.283405:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548794.312158:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548795.332715:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548796.355657:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787548796.421242:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3418829f-2e19-44b5-ae62-1256ac42dc62->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787548796.421257:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3418829f-2e19-44b5-ae62-1256ac42dc62->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787548796.423676:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787548796.423713:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431901056:0@lo:400:kworker.0 00000400:00000100:1.0:1787548796.423793:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874380431901056 offset 0 length 224: 4 00000100:00100000:0.0:1787548796.931798:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787548786/real 1787548786] req@ffff8fecb51cdc00 x1874380431900800/t0(0) o250->MGC192.168.206.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787548796 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548796.931843:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fecb51cdc00 x1874380431900800/t0(0) o250->MGC192.168.206.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787548796 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548796.931856:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787548786/real 1787548786] req@ffff8fecad560e00 x1874380431900544/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787548796 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548796.931871:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fecad560e00 x1874380431900544/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787548796 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787548796.931893:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fec88664000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787548796.931921:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787548796.931926:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3418829f-2e19-44b5-ae62-1256ac42dc62:3312:1874380431900800:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1787548796.931933:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fecb3412800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787548796.931953:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1874380431900544:0@lo:39:umount.0 00000100:00080000:1.0:1787548796.932077:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787548796.932082:0:13128:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787548796.932088:0:13128:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787548796.933383:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e83a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548796.933414:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e83a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548796.933423:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e83a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548796.933431:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e83a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548796.933464:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787548796.933473:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424ea55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548796.933481:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424ea55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548796.933488:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424ea55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548796.933495:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424ea55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548796.933517:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787548796.933522:0:13128:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1787548796.933833:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787548796.933841:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e83a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548796.933849:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151600 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:2.0:1787548796.933853:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e83a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548796.933861:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb7c48919424e83a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787548796.933868:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb7c48919424e83a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548796.933874:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787548796.933877:0:8452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787548796.933879:0:8452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787548796.933897:0:8452:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fec88664000 00010000:00010000:2.0:1787548796.933902:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb7c48919424e83a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548796.933908:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec90151600/0xcb7c48919424e833 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb7c48919424e83a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548796.933925:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548796.933928:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424ea55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548796.933942:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92400 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:2.0:1787548796.933944:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424ea55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548796.933951:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb7c48919424ea55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787548796.933957:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb7c48919424ea55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548796.933962:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787548796.933965:0:8452:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787548796.933966:0:8452:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787548796.933974:0:8452:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fec88664000 00010000:00010000:2.0:1787548796.933977:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb7c48919424ea55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548796.933984:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424ea4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb7c48919424ea55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548796.933994:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548796.933996:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548796.933999:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787548796.934075:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3418829f-2e19-44b5-ae62-1256ac42dc62->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787548796.934081:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787548796.934084:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fec88664000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787548796.934093:0:37:0:(import.c:510:import_select_connection()) MGC192.168.206.113@tcp: connect to NID 0@lo last attempt 409 00000100:00080000:2.0:1787548796.934099:0:37:0:(import.c:589:import_select_connection()) MGC192.168.206.113@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787548796.934112:0:37:0:(import.c:624:import_select_connection()) MGC192.168.206.113@tcp: import ffff8fec88664000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:2.0:1787548796.934187:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecb51f3100 x1874380431901184/t0(0) o250->MGC192.168.206.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1787548796.934336:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548796.934356:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3418829f-2e19-44b5-ae62-1256ac42dc62:3312:1874380431901184:0@lo:250:kworker.0 00000400:00000100:0.0:1787548796.934438:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874380431901184 offset 0 length 520: 4 00000020:01000004:1.0:1787548796.934783:0:13128:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787548796.934789:0:13128:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787548796.934796:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787548796.934804:0:13128:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787548796.934810:0:13128:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8fec882e99b8) has no exports 00000020:00080000:1.0:1787548796.934841:0:13128:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8fec882e99b8) has no exports 00000020:01000000:1.0:1787548796.942114:0:13128:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fec85d39180 - data ffff8fecb83d1798/ffff8fecb7e0b800 00000020:01000000:3.0:1787548796.947674:0:13128:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fecba1ca3c0 - data ffff8fecb83f2360/ffff8fecb7de8800 00100000:10000000:3.0:1787548796.975876:0:13128:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787548797.005090:0:13128:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e626 00000020:00000080:3.0:1787548797.005099:0:13128:0:(genops.c:885:class_export_put()) final put ffff8fecad08d000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787548797.005119:0:13128:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fecad08a800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787548797.005123:0:13128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fecad08a800 2 00000020:01000004:3.0:1787548797.005126:0:13128:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fecad08a800 from lustre-OST0000 00000020:00000080:3.0:1787548797.005170:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787548797.005178:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787548797.005181:0:13128:0:(genops.c:885:class_export_put()) final put ffff8fec88442000/lustre-OST0000_UUID 00000020:00000080:3.0:1787548797.005184:0:13128:0:(genops.c:844:class_export_destroy()) destroying export ffff8fec88442000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787548797.005193:0:13128:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787548797.005228:0:13128:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787548797.005232:0:13128:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787548797.005235:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787548797.005240:0:13128:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787548797.005245:0:13128:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8fecad8a6800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787548797.005251:0:13128:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8feb811e99b8) has exports, disconnecting them 00000020:00080000:3.0:1787548797.005266:0:13128:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8fecad8a6800), last request at 1787548585 00000020:00000080:3.0:1787548797.005270:0:13128:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e650 00000020:00080000:3.0:1787548797.005279:0:13128:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fecad8a6800): rc 0 00000020:00000080:3.0:1787548797.005283:0:13128:0:(genops.c:885:class_export_put()) final put ffff8fecad8a6800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787548797.006207:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecad08d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787548797.006223:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecad8a6800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787548797.009203:0:13128:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787548797.009211:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787548797.009215:0:13128:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787548797.009222:0:13128:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787548797.009421:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787548797.009431:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787548797.009437:0:13128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fecad08a800 1 00000020:00000080:0.0:1787548797.009444:0:13128:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e5e0 00000020:00000080:0.0:1787548797.009452:0:13128:0:(genops.c:885:class_export_put()) final put ffff8fecad088800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787548797.009457:0:13128:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787548797.009462:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787548797.009465:0:13128:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787548797.009469:0:13128:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8fecad894d28) has no exports 00000020:00000080:1.0:1787548797.009650:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fecb3412800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787548797.009656:0:37:0:(genops.c:885:class_export_put()) final put ffff8fecaf31e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787548797.009659:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecaf31e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787548797.009665:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787548797.009709:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecad088800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787548797.023601:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787548797.023615:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787548797.023620:0:13128:0:(genops.c:885:class_export_put()) final put ffff8fecad08a000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787548797.023625:0:13128:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecad08a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787548797.023632:0:13128:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787548797.023766:0:13128:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8fecad08f000 00000020:02000400:1.0:1787548797.023809:0:13128:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787548797.379344:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548798.403384:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548799.430248:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787548799.758393:0:13281:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787548799.773300:0:13281:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787548799.773387:0:13281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e810 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548799.773401:0:13281:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e810 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548799.773408:0:13281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e810 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548799.773428:0:13281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e810 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548799.773446:0:13281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787548799.773452:0:13281:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787548799.773473:0:13281:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787548799.773484:0:13281:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fec8833c000 x1874380431900416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548802 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548799.773673:0:13281:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fecb51f1880 x1874380431900928/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548807 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548799.773689:0:13281:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fecb51cdf80 x1874380431901056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548812 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548799.773696:0:13281:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1787548799.773722:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431901056:0@lo:400:kworker.0 00000100:00100000:1.0:1787548799.773730:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874380431900928:0@lo:400:kworker.0 00000100:00080000:1.0:1787548799.773769:0:13281:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787548799.773792:0:13281:0:(import.c:65:import_set_state_nolock()) ffff8feb81f24800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787548799.774843:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548799.774854:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e810 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548799.774863:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec81534400 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:0.0:1787548799.774867:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e810 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548799.774876:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb7c48919424e810 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787548799.774894:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb7c48919424e810 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548799.774900:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787548799.774903:0:5843:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787548799.774919:0:5843:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787548799.774936:0:5843:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fec88664000 00010000:00010000:0.0:1787548799.774940:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb7c48919424e810 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548799.774947:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec81534400/0xcb7c48919424e809 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb7c48919424e810 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548799.775960:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431900416:0@lo:400:kworker.0 00010000:00010000:0.0:1787548799.776115:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548799.776119:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548799.776121:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548799.776160:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1874380431901312:0@lo:39:umount.0 00000400:00000100:0.0:1787548799.776205:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874380431901312 offset 0 length 224: 4 00010000:00010000:0.0:1787548800.451436:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548801.478735:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787548802.054056:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3418829f-2e19-44b5-ae62-1256ac42dc62->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787548802.054068:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3418829f-2e19-44b5-ae62-1256ac42dc62->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787548802.500377:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548803.523403:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548804.547484:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548805.571403:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548806.595499:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787548807.171317:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3418829f-2e19-44b5-ae62-1256ac42dc62->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787548807.171327:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3418829f-2e19-44b5-ae62-1256ac42dc62->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787548807.619343:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548808.643756:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548809.670006:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548809.987305:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787548799/real 1787548799] req@ffff8fec8833f800 x1874380431901312/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787548809 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548809.987336:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fec8833f800 x1874380431901312/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787548809 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787548809.987354:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8feb81f24800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787548809.987374:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1874380431901312:0@lo:39:umount.0 00000100:00080000:1.0:1787548809.987464:0:13281:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787548809.987469:0:13281:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787548809.987474:0:13281:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787548809.988356:0:13281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424e81e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548809.988369:0:13281:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424e81e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548809.988389:0:13281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e81e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548809.988395:0:13281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424e81e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548809.988424:0:13281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787548809.988438:0:13281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424ea47 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548809.988444:0:13281:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424ea47 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548809.988450:0:13281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424ea47 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548809.988455:0:13281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb7c48919424ea47 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548809.988934:0:13281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787548809.988941:0:13281:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787548809.988963:0:13281:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787548809.988966:0:13281:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787548809.988971:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787548809.988976:0:13281:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787548809.988980:0:13281:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8feb811e8000) has no exports 00000020:00080000:1.0:1787548809.989001:0:13281:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8feb811e8000) has no exports 00010000:00010000:0.0:1787548809.991315:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787548809.991331:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e81e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548809.991343:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec81534e00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:0.0:1787548809.991347:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424e81e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548809.991358:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb7c48919424e81e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787548809.991384:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb7c48919424e81e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548809.991390:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787548809.991393:0:5843:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787548809.991396:0:5843:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787548809.991414:0:5843:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fec88664000 00010000:00010000:0.0:1787548809.991418:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb7c48919424e81e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548809.991425:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec81534e00/0xcb7c48919424e817 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb7c48919424e81e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548809.991627:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548809.991631:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424ea47 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548809.991637:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fc00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:0.0:1787548809.991640:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb7c48919424ea47 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548809.991647:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb7c48919424ea47 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787548809.991653:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb7c48919424ea47 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548809.991658:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787548809.991660:0:5843:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787548809.991669:0:5843:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787548809.991675:0:5843:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fec88664000 00010000:00010000:0.0:1787548809.991678:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb7c48919424ea47 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548809.991685:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fc00/0xcb7c48919424ea40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb7c48919424ea47 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548809.991697:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548809.991700:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548809.991702:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548809.992626:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787548809.992746:0:13281:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fec85d39de0 - data ffff8fecb83d1000/ffff8fecb513c000 00000020:01000000:1.0:1787548809.993603:0:13281:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fecbca03b40 - data ffff8fec9f832af8/ffff8fec905c9800 00100000:10000000:1.0:1787548810.002170:0:13281:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787548810.073660:0:13281:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e6ff 00000020:00000080:2.0:1787548810.073670:0:13281:0:(genops.c:885:class_export_put()) final put ffff8fecb7db8000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787548810.073690:0:13281:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fec88445800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787548810.073694:0:13281:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fec88445800 2 00000020:01000004:2.0:1787548810.073698:0:13281:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fec88445800 from lustre-OST0001 00000020:00000080:2.0:1787548810.073721:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787548810.073732:0:13281:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787548810.073735:0:13281:0:(genops.c:885:class_export_put()) final put ffff8fecb7db9800/lustre-OST0001_UUID 00000020:00000080:2.0:1787548810.073738:0:13281:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecb7db9800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787548810.073745:0:13281:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787548810.073853:0:13281:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 3418829f-2e19-44b5-ae62-1256ac42dc62->MGS 00010000:00010000:2.0:1787548810.073867:0:13281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecc21eda00/0xcb7c48919424e603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb7c48919424e60a expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787548810.073879:0:13281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecc21eda00/0xcb7c48919424e603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb7c48919424e60a expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548810.073895:0:13281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787548810.073898:0:13281:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787548810.073901:0:13281:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787548810.073915:0:13281:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fec88664000 00010000:00010000:2.0:1787548810.073919:0:13281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecc21eda00/0xcb7c48919424e603 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb7c48919424e60a expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548810.073934:0:13281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec81535600/0xcb7c48919424e85d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb7c48919424e864 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787548810.073941:0:13281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec81535600/0xcb7c48919424e85d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb7c48919424e864 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548810.073945:0:13281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787548810.073948:0:13281:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787548810.073949:0:13281:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787548810.073957:0:13281:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fec88664000 00010000:00010000:2.0:1787548810.073960:0:13281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec81535600/0xcb7c48919424e85d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb7c48919424e864 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787548810.073975:0:13281:0:(import.c:65:import_set_state_nolock()) ffff8fec88664000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787548810.073980:0:13281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787548810.073982:0:13281:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787548810.073983:0:13281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787548810.073987:0:13281:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787548810.073997:0:13281:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fecb51f3100 x1874380431901184/t0(0) o250->MGC192.168.206.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787548811 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787548810.074019:0:13281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787548810.074022:0:13281:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000020:00000080:1.0:1787548810.074070:0:12905:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecb7db8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1787548810.074190:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3418829f-2e19-44b5-ae62-1256ac42dc62:3312:1874380431901184:0@lo:250:kworker.0 10000000:01000000:2.0:1787548810.074434:0:13281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787548810.074447:0:13281:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e4f2 00000020:00000080:2.0:1787548810.074452:0:13281:0:(genops.c:885:class_export_put()) final put ffff8fec83798800/3418829f-2e19-44b5-ae62-1256ac42dc62 00000020:01000000:2.0:1787548810.074473:0:13281:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.113@tcp (flags='') 00000020:00000080:2.0:1787548810.074478:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787548810.074483:0:13281:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.113@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787548810.074486:0:13281:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8fec87eab370) has no exports 00000020:00000080:1.0:1787548810.074534:0:12905:0:(genops.c:844:class_export_destroy()) destroying export ffff8fec83798800/3418829f-2e19-44b5-ae62-1256ac42dc62 for MGC192.168.206.113@tcp 10000000:01000000:0.0:1787548810.074573:0:5851:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787548810.074648:0:13281:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.113@tcp: client import never connected 00000100:00080000:2.0:1787548810.074651:0:13281:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787548810.074653:0:13281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787548810.074655:0:13281:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787548810.074657:0:13281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787548810.074696:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787548810.074700:0:13281:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.113@tcp (uuid 3418829f-2e19-44b5-ae62-1256ac42dc62) 00000020:01000000:2.0:1787548810.074704:0:13281:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787548810.074707:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787548810.074711:0:13281:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787548810.074715:0:13281:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8fecacdef800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787548810.074720:0:13281:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8feb81f399b8) has exports, disconnecting them 00000020:00080000:2.0:1787548810.074724:0:13281:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8fecacdef800), last request at 1787548603 00000020:00000080:2.0:1787548810.074728:0:13281:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e729 00000020:00080000:2.0:1787548810.074737:0:13281:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fecacdef800): rc 0 00000020:00000080:2.0:1787548810.074740:0:13281:0:(genops.c:885:class_export_put()) final put ffff8fecacdef800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787548810.075450:0:12905:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fec88664000 for MGC192.168.206.113@tcp 00000020:00000080:1.0:1787548810.075460:0:12905:0:(genops.c:885:class_export_put()) final put ffff8fec8644f000/3418829f-2e19-44b5-ae62-1256ac42dc62 00000020:00000080:1.0:1787548810.075462:0:12905:0:(genops.c:844:class_export_destroy()) destroying export ffff8fec8644f000/3418829f-2e19-44b5-ae62-1256ac42dc62 for MGC192.168.206.113@tcp 00000020:01000000:1.0:1787548810.075480:0:12905:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.113@tcp (3418829f-2e19-44b5-ae62-1256ac42dc62) 00000020:00000080:1.0:1787548810.075717:0:12905:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecacdef800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787548810.088205:0:13281:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787548810.088213:0:13281:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787548810.088218:0:13281:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787548810.088224:0:13281:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787548810.088350:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1787548810.088585:0:12905:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8feb81f24800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787548810.088629:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787548810.088795:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1787548810.088914:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1787548810.089075:0:5838:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8fec86072e00:5838] 1 exiting: rc = 0 00000100:00100000:0.0:1787548810.089239:0:5837:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8fec86073e00:5837] 0 exiting: rc = 1 00000100:00100000:2.0:1787548810.089334:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.089642:0:5841:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8fec86072000:5841] 2 exiting: rc = 0 00000100:00100000:1.0:1787548810.089742:0:5840:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8fec85c67800:5840] 1 exiting: rc = 0 00000100:00100000:0.0:1787548810.089823:0:8453:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8fecb7e65000:8453] 3 exiting: rc = 0 00000100:00100000:3.0:1787548810.089975:0:5839:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8fec85c66000:5839] 0 exiting: rc = 1 00000100:00100000:2.0:1787548810.090229:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090238:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090244:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090260:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090266:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090272:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090279:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090284:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090290:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090307:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090312:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090318:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090324:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090329:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090335:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090340:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090347:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090352:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090357:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090362:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090367:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090372:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090377:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090382:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090387:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090392:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090397:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090402:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090406:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090411:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090416:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090421:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090427:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090431:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090436:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090441:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090446:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090451:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090623:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090631:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090636:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090641:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090646:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090651:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090656:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090661:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090665:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090671:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090675:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090680:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090684:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090689:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090693:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090698:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090703:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090707:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090712:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090717:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090721:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090726:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090730:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090735:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090740:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.090745:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787548810.091729:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787548810.091737:0:13281:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787548810.091743:0:13281:0:(genops.c:885:class_export_put()) final put ffff8feb81f26800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787548810.091746:0:13281:0:(genops.c:844:class_export_destroy()) destroying export ffff8feb81f26800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787548810.091752:0:13281:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787548810.091789:0:13281:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fec88445800 1 00000020:00000080:2.0:1787548810.091794:0:13281:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424e6ce 00000020:00000080:2.0:1787548810.091800:0:13281:0:(genops.c:885:class_export_put()) final put ffff8fecace68800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787548810.091853:0:13281:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787548810.091858:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787548810.091862:0:13281:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787548810.091866:0:13281:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8fec86110000) has no exports 00000020:00000080:1.0:1787548810.092419:0:12905:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecace68800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787548810.103268:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787548810.103284:0:13281:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787548810.103290:0:13281:0:(genops.c:885:class_export_put()) final put ffff8fec88441800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787548810.103304:0:13281:0:(genops.c:844:class_export_destroy()) destroying export ffff8fec88441800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787548810.103311:0:13281:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787548810.103661:0:13281:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8fec88447800 00000020:01000000:2.0:1787548810.103686:0:13281:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787548810.103691:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787548810.103695:0:13281:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787548810.103700:0:13281:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8fecad890000) has no exports 00000020:00000080:2.0:1787548810.103725:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787548810.103731:0:13281:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787548810.103734:0:13281:0:(genops.c:885:class_export_put()) final put ffff8fecad08c000/OSS_uuid 00000020:00000080:2.0:1787548810.103736:0:13281:0:(genops.c:844:class_export_destroy()) destroying export ffff8fecad08c000/OSS_uuid for OSS 00000020:01000000:2.0:1787548810.103739:0:13281:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787548810.103848:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8fec851a1600:6690] 0 exiting: rc = 1 00000100:00100000:2.0:1787548810.103930:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8fec836d7000:6692] 2 exiting: rc = 0 00000100:00100000:0.0:1787548810.106058:0:10297:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8fecb7d3de00:10297] 3 exiting: rc = 0 00000100:00100000:0.0:1787548810.106174:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8fec851a1400:6691] 1 exiting: rc = 0 00000100:00100000:2.0:1787548810.106481:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106488:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106494:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106500:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106505:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106511:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106517:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106521:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106526:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106531:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106536:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106541:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106561:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106566:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106571:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106576:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106581:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106585:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106591:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106596:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106600:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106605:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106610:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106615:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106619:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106623:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106628:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106632:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106637:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106642:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106646:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106651:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106656:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106661:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106665:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106670:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106675:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106680:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106685:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106689:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106694:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106698:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106703:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106707:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106712:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106717:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106721:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106734:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106738:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106743:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106748:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106752:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106758:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106763:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106769:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106774:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106780:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106785:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106791:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106795:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106800:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106806:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106811:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.106817:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.107576:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8fec836d7400:6693] 0 exiting: rc = 1 00000100:00100000:3.0:1787548810.107909:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8fec836d6a00:6694] 1 exiting: rc = 0 00000100:00100000:0.0:1787548810.108096:0:11969:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8fecb42d3000:11969] 2 exiting: rc = 0 00000100:00100000:2.0:1787548810.108227:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108235:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108241:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108246:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108251:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108257:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108262:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108268:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108274:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108279:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108285:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108301:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108309:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108314:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108319:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108325:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108330:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108344:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108348:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108353:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108358:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108363:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108388:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108395:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108400:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108405:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108410:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108416:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108422:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108427:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108432:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108438:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108455:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108461:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108600:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108608:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108613:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108619:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108624:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108630:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108636:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108641:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108646:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108651:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108656:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108661:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108666:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108672:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108677:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108681:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108686:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108692:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108705:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108710:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108716:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108721:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108726:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108731:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108737:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108742:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108747:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108752:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108756:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.108762:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:1.0:1787548810.109540:0:5850:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787548810.109718:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8fec851a2c00:6697] 2 exiting: rc = 0 00000100:00100000:2.0:1787548810.109898:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8fec851a3400:6695] 0 exiting: rc = 1 00000100:00100000:0.0:1787548810.110094:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8fecacf08600:6696] 1 exiting: rc = 0 00000100:00100000:2.0:1787548810.110214:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110221:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110226:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110232:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110236:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110240:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110246:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110251:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110256:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110261:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110266:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110271:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110276:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110282:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110286:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110302:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110309:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110313:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110318:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110323:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110327:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110334:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110351:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110357:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110362:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110367:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110372:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110378:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110384:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110390:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110408:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110414:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110419:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110424:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110429:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110434:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110439:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110549:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110556:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110562:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110567:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110572:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110578:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110583:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110589:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110595:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110600:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110605:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110611:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110616:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110621:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110627:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110632:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110638:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110644:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110650:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110656:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110669:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110689:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110696:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110702:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110707:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110712:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.110718:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787548810.115096:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8fec8601c000:6698] 0 exiting: rc = 1 00000100:00100000:2.0:1787548810.115434:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8fecacf09600:6699] 1 exiting: rc = 0 00000100:00100000:2.0:1787548810.115495:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115502:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115508:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115513:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115518:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115523:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115528:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115534:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115539:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115544:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115549:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115553:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115558:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115562:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115567:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115572:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115577:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115582:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115587:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115591:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115597:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115603:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115609:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115614:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115619:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115625:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115631:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115649:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115655:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115661:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115666:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115671:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115678:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115683:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115689:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115694:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115700:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115704:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115711:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115717:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115722:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115728:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115733:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115739:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115744:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115750:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115755:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115761:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115767:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115772:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115778:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115784:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115789:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115794:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115800:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115805:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115810:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115815:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115820:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115826:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115832:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115837:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115850:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.115855:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787548810.116708:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8fec8848bc00:6701] 0 exiting: rc = 1 00000100:00100000:3.0:1787548810.116924:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8fec8848a200:6702] 1 exiting: rc = 0 00000100:00100000:2.0:1787548810.117036:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117042:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117054:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117061:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117067:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117073:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117078:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117110:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117117:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117123:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117145:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117151:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117157:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117162:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117168:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117174:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117179:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117185:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117190:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117211:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117219:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117226:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117232:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117238:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117246:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117253:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117260:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117268:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117274:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117282:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117289:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117324:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117331:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117347:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117354:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117360:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117366:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117372:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117379:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117386:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117392:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117399:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117407:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117429:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117436:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117449:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117455:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117461:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117467:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117472:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117477:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117484:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117490:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117496:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117502:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117524:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117534:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117545:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117553:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117560:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117566:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117573:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117579:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787548810.117595:0:13281:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787548810.126420:0:13281:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787548826.755529:0:13899:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg613-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787548835.375831:0:14361:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787548835.375837:0:14361:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787548835.375957:0:14361:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fecba22b800 00000020:01000004:3.0:1787548835.375970:0:14361:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787548835.375977:0:14361:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787548835.375989:0:14361:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8feb81f3cd28) 00000020:00000080:3.0:1787548835.376000:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787548835.402590:0:14361:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787548835.409664:0:14361:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787548835.412313:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 235: rc = 0 00100000:10000000:2.0:1787548835.412574:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 235: rc = 0 00100000:10000000:2.0:1787548835.413688:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 235: rc = 0 00100000:10000000:2.0:1787548835.413913:0:14361:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787548835.414004:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 235: rc = 0 00100000:10000000:2.0:1787548835.414454:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 235: rc = 0 00100000:10000000:2.0:1787548835.414632:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 235: rc = 0 00100000:10000000:3.0:1787548835.419528:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 237: rc = 0 00100000:10000000:3.0:1787548835.424437:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 555: rc = 0 00100000:10000000:3.0:1787548835.424604:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 555: rc = 0 00100000:10000000:3.0:1787548835.425430:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 439: rc = 0 00100000:10000000:3.0:1787548835.425751:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 439: rc = 0 00100000:10000000:3.0:1787548835.426274:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 439: rc = 0 00100000:10000000:3.0:1787548835.426965:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 439: rc = 0 00100000:10000000:3.0:1787548835.427445:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 439: rc = 0 00100000:10000000:3.0:1787548835.427919:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 439: rc = 0 00100000:10000000:3.0:1787548835.428511:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 439: rc = 0 00100000:10000000:3.0:1787548835.429092:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 439: rc = 0 00100000:10000000:3.0:1787548835.429465:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 439: rc = 0 00100000:10000000:3.0:1787548835.430297:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 439: rc = 0 00100000:10000000:3.0:1787548835.430647:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 439: rc = 0 00100000:10000000:3.0:1787548835.431275:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 439: rc = 0 00100000:10000000:3.0:1787548835.431909:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 651: rc = 0 00100000:10000000:3.0:1787548835.432292:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 651: rc = 0 00100000:10000000:3.0:1787548835.432623:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 651: rc = 0 00100000:10000000:3.0:1787548835.433132:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 651: rc = 0 00100000:10000000:3.0:1787548835.433427:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 651: rc = 0 00100000:10000000:3.0:1787548835.433888:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 651: rc = 0 00100000:10000000:3.0:1787548835.434250:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 651: rc = 0 00100000:10000000:3.0:1787548835.434497:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 651: rc = 0 00100000:10000000:3.0:1787548835.434958:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 651: rc = 0 00100000:10000000:3.0:1787548835.435331:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 651: rc = 0 00100000:10000000:3.0:1787548835.435661:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 651: rc = 0 00100000:10000000:3.0:1787548835.436222:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 651: rc = 0 00100000:10000000:3.0:1787548835.436465:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 651: rc = 0 00100000:10000000:3.0:1787548835.436897:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 651: rc = 0 00100000:10000000:3.0:1787548835.437248:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 651: rc = 0 00100000:10000000:3.0:1787548835.437490:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 651: rc = 0 00100000:10000000:3.0:1787548835.438097:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 651: rc = 0 00100000:10000000:3.0:1787548835.438387:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 651: rc = 0 00100000:10000000:3.0:1787548835.438719:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 651: rc = 0 00100000:10000000:3.0:1787548835.439398:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 651: rc = 0 00100000:10000000:3.0:1787548835.439817:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 651: rc = 0 00100000:10000000:3.0:1787548835.440176:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 651: rc = 0 00100000:10000000:3.0:1787548835.440559:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 651: rc = 0 00100000:10000000:3.0:1787548835.440818:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 651: rc = 0 00100000:10000000:3.0:1787548835.441085:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 651: rc = 0 00100000:10000000:3.0:1787548835.441524:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 651: rc = 0 00100000:10000000:3.0:1787548835.442187:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 651: rc = 0 00100000:10000000:3.0:1787548835.442650:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 651: rc = 0 00100000:10000000:3.0:1787548835.442919:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 651: rc = 0 00100000:10000000:3.0:1787548835.443357:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 651: rc = 0 00100000:10000000:3.0:1787548835.443670:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 651: rc = 0 00100000:10000000:3.0:1787548835.443915:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 651: rc = 0 00100000:10000000:3.0:1787548835.444432:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 453: rc = 0 00100000:10000000:3.0:1787548835.444987:0:14361:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787548835.445359:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 556: rc = 0 00100000:10000000:3.0:1787548835.445628:0:14361:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787548835.445700:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 556: rc = 0 00100000:10000000:3.0:1787548835.445886:0:14361:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787548835.445948:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 556: rc = 0 00100000:10000000:3.0:1787548835.446404:0:14361:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787548835.446870:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1787548835.447246:0:14361:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787548835.447321:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:3.0:1787548835.447509:0:14361:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787548835.447651:0:14361:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 768: rc = 0 00000020:00000080:3.0:1787548835.447939:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787548835.447946:0:14361:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787548835.447956:0:14361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb7c48919424f7f3 00000020:01000004:3.0:1787548835.447964:0:14361:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787548835.447968:0:14361:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787548835.447973:0:14361:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fecba22b800 from MGS 00000020:01000004:3.0:1787548835.447977:0:14361:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787548835.447986:0:14361:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8feb81f38000) 00000020:00000080:3.0:1787548835.447996:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787548835.448304:0:14361:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fecba22b800 from MGS, refs=2 00080000:01000000:3.0:1787548835.448309:0:14361:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787548835.448315:0:14361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb7c48919424f801 00000100:00100000:3.0:1787548835.448403:0:14361:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787548835.448606:0:14361:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787548835.448613:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787548835.453814:0:14361:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787548835.453829:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787548835.454913:0:14361:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787548835.455466:0:14361:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787548835.455472:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787548835.456449:0:14361:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787548835.456518:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787548835.456894:0:14361:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787548835.456900:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787548835.457831:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548835.457836:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548835.457838:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548835.458411:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548835.458414:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548835.458416:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548835.459190:0:14361:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787548835.460484:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787548835.478825:0:14361:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787548835.478841:0:14361:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787548835.478844:0:14361:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787548835.481073:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787548835.481253:0:14361:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787548835.481362:0:14361:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787548835.481811:0:14361:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787548835.482110:0:14361:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787548835.482297:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787548835.482303:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787548835.493248:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787548835.493261:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787548835.498086:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787548835.498275:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787548835.499036:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787548835.499057:0:14361:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.113@tcp' 00000020:01000004:1.0:1787548835.499059:0:14361:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787548835.499085:0:14361:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.113@tcp (typ=mgc) 00000020:00000080:1.0:1787548835.499097:0:14361:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.113@tcp (ffff8feb811e99b8) 00000020:00000080:1.0:1787548835.499125:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787548835.499224:0:14361:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8feb81e0f800@MGC192.168.206.113@tcp: add connection 192.168.206.113@tcp at head 00010000:00010000:1.0:1787548835.499382:0:14361:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.113@tcp-0 is initialized 00000040:01000000:1.0:1787548835.499388:0:14361:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.113@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787548835.501385:0:14375:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787548835.501809:0:14377:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787548835.501885:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.113@tcp (uuid 50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c) 00000020:00000080:2.0:1787548835.501907:0:14361:0:(genops.c:1385:class_connect()) connect: client 50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c, cookie 0xcb7c48919424f80f 00000100:00080000:2.0:1787548835.501919:0:14361:0:(import.c:510:import_select_connection()) MGC192.168.206.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787548835.501924:0:14361:0:(import.c:624:import_select_connection()) MGC192.168.206.113@tcp: import ffff8feb81e0f800 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:2.0:1787548835.501955:0:14361:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecb51f2300 x1874380431901440/t0(0) o250->MGC192.168.206.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787548835.501983:0:14361:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c->MGS 00000020:01000004:2.0:1787548835.502010:0:14361:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787548835.502014:0:14361:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787548835.502026:0:14361:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8fec86110000) 00000020:00000080:2.0:1787548835.502037:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787548835.502303:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3312:1874380431901440:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787548835.502377:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548835.502440:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431901440 00000100:00100000:1.0:1787548835.502447:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431901440 00000100:00100000:1.0:1787548835.502473:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548835.502480:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3312:x1874380431901440:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787548835.502502:0:14371:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:1.0:1787548835.502522:0:14371:0:(genops.c:1385:class_connect()) connect: client 50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c, cookie 0xcb7c48919424f81d 00000100:00080000:1.0:1787548835.502640:0:14371:0:(import.c:65:import_set_state_nolock()) ffff8feb81e0d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787548835.502690:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+5:3312:x1874380431901440:12345-0@lo:250:mount.lustre.0 Request processed in 208us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548835.502697:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548835.502739:0:3312:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787548835.502746:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.113@tcp: connect to target with instance 0 00000100:00080000:1.0:1787548835.502751:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787548835.502755:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787548835.502758:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8feb81e0f800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787548835.502760:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787548835.502766:0:3312:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787548835.502771:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3312:1874380431901440:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787548835.514941:0:14361:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787548835.517544:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787548835.517552:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787548835.518065:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787548835.518072:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787548835.522084:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787548835.522095:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787548835.533854:0:14361:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787548835.534028:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787548835.534034:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787548835.534669:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787548835.534676:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787548835.638761:0:14361:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787548835.639073:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787548835.639080:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787548835.640732:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787548835.640745:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787548835.641389:0:14361:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787548835.641556:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787548835.641560:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787548835.642617:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787548835.642626:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787548835.644800:0:14361:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787548835.645517:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787548835.645525:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787548835.646368:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787548835.646512:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787548835.647396:0:14361:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787548835.647622:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787548835.647628:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787548835.648605:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787548835.648613:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787548835.762817:0:14361:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787548835.763259:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787548835.763268:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787548835.765173:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787548835.765187:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787548835.770442:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787548835.770459:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787548835.771687:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787548835.771711:0:14361:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787548835.771729:0:14361:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787548835.771870:0:14361:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787548835.771905:0:14361:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.113@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787548835.771909:0:14361:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787548835.771911:0:14361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787548835.771912:0:14361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787548835.771914:0:14361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787548835.771915:0:14361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787548835.771916:0:14361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787548835.771918:0:14361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787548835.771919:0:14361:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787548835.771921:0:14361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787548835.771922:0:14361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787548835.771924:0:14361:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787548835.771926:0:14361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787548835.771928:0:14361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787548835.771929:0:14361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787548835.771930:0:14361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787548835.771931:0:14361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787548835.771932:0:14361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787548835.771933:0:14361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787548835.771934:0:14361:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787548835.771935:0:14361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787548835.771936:0:14361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787548835.772248:0:14361:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787548835.772271:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431901568:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787548835.772348:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548835.772457:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecb52bcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787548835.773790:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431901568 00000100:00100000:2.0:1787548835.773802:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431901568 00000100:00100000:2.0:1787548835.773897:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787548835.773907:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+5:14361:x1874380431901568:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787548835.773986:0:14374:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787548835.773989:0:14374:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787548835.773992:0:14374:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787548835.774603:0:14395:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787548835.775387:0:14374:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787548835.777272:0:14396:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787548835.777280:0:14396:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787548835.777283:0:14396:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787548835.777322:0:14396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787548835.777781:0:14374:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787548835.777791:0:14374:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787548835.805403:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+5:14361:x1874380431901568:12345-0@lo:253:mount.lustre.0 Request processed in 31488us (33046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548835.805422:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787548835.805511:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431901568:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787548835.805544:0:14361:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787548835.805548:0:14361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787548835.805550:0:14361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787548835.805551:0:14361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787548835.805552:0:14361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787548835.805553:0:14361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787548835.805554:0:14361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787548835.805555:0:14361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787548835.805557:0:14361:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787548835.805558:0:14361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787548835.805560:0:14361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787548835.805580:0:14361:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fecba22b800 from lustre-MDT0000 10000000:01000000:3.0:1787548835.805608:0:14361:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787548835.805610:0:14361:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787548835.805615:0:14361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8feb811e99b8 10000000:01000000:3.0:1787548835.805618:0:14361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787548835.805626:0:14361:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8feb811e99b8 from 1 10000000:01000000:3.0:1787548835.805630:0:14361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787548835.805672:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92c00/0xcb7c48919424f824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548835.805683:0:14361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92c00/0xcb7c48919424f824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548835.805693:0:14361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92c00/0xcb7c48919424f824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548835.805712:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431901696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787548835.805749:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548835.805833:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d2ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548835.805873:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431901696 00000100:00100000:1.0:1787548835.805881:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431901696 00000100:00100000:1.0:1787548835.805981:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787548835.805991:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+5:14361:x1874380431901696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787548835.806003:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548835.806024:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbd22e400/0xcb7c48919424f82b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424f824 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548835.806046:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbd22e400/0xcb7c48919424f82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424f824 expref: 6 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548835.806056:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbd22e400/0xcb7c48919424f82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f824 expref: 6 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548835.806065:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22e400, rc 0) 00000100:00100000:1.0:1787548835.806105:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+6:14361:x1874380431901696:12345-0@lo:101:mount.lustre.0 Request processed in 116us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548835.806111:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787548835.806203:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431901696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787548835.806216:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92c00/0xcb7c48919424f824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f82b expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548835.806232:0:14361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92c00/0xcb7c48919424f824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424f82b expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548835.806277:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431901824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787548835.806303:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548835.806482:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d2ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548835.806538:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431901824 00000100:00100000:2.0:1787548835.806543:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431901824 00000100:00100000:2.0:1787548835.806567:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787548835.806573:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+6:14361:x1874380431901824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787548835.806842:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+6:14361:x1874380431901824:12345-0@lo:501:mount.lustre.0 Request processed in 267us (536us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787548835.806849:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787548835.806954:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431901824:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787548835.806980:0:14361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787548835.807031:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92c00/0xcb7c48919424f824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f82b expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548835.807040:0:14361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92c00/0xcb7c48919424f824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f82b expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548835.807049:0:14361:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fecba22b800 10000000:01000000:3.0:1787548835.807053:0:14361:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787548835.807056:0:14361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8fecba22b800 10000000:01000000:3.0:1787548835.807059:0:14361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787548835.807062:0:14361:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8fecba22b800 from 1 10000000:01000000:3.0:1787548835.807064:0:14361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787548835.807082:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92a00/0xcb7c48919424f832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548835.807089:0:14361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92a00/0xcb7c48919424f832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548835.807097:0:14361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92a00/0xcb7c48919424f832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548835.807117:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431901952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787548835.807190:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548835.807207:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d2ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548835.807270:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431901952 00000100:00100000:2.0:1787548835.807275:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431901952 00000100:00100000:2.0:1787548835.807301:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787548835.807308:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+6:14361:x1874380431901952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787548835.807317:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548835.807329:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec813f6e00/0xcb7c48919424f839 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424f832 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548835.807344:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec813f6e00/0xcb7c48919424f839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424f832 expref: 7 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548835.807353:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec813f6e00/0xcb7c48919424f839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f832 expref: 7 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548835.807361:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f6e00, rc 0) 00000100:00100000:2.0:1787548835.807389:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+7:14361:x1874380431901952:12345-0@lo:101:mount.lustre.0 Request processed in 82us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548835.807397:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787548835.807537:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431901952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787548835.807550:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92a00/0xcb7c48919424f832 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f839 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548835.807558:0:14361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92a00/0xcb7c48919424f832 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424f839 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548835.807569:0:14361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787548835.807733:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92a00/0xcb7c48919424f832 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f839 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548835.807741:0:14361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92a00/0xcb7c48919424f832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f839 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548835.807747:0:14361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787548835.807752:0:14361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787548835.807756:0:14361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8fecba22b800 10000000:01000000:3.0:1787548835.807759:0:14361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787548835.807762:0:14361:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787548835.807765:0:14361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787548835.807778:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93a00/0xcb7c48919424f840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548835.807785:0:14361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93a00/0xcb7c48919424f840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548835.807800:0:14361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93a00/0xcb7c48919424f840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548835.807813:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431902080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787548835.807841:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548835.807863:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d2ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548835.807911:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431902080 00000100:00100000:2.0:1787548835.807915:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431902080 00000100:00100000:2.0:1787548835.807983:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787548835.807992:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+7:14361:x1874380431902080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787548835.808006:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548835.808015:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec813f7200/0xcb7c48919424f847 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424f840 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548835.808030:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec813f7200/0xcb7c48919424f847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424f840 expref: 8 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548835.808038:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec813f7200/0xcb7c48919424f847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f840 expref: 8 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548835.808045:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7200, rc 0) 00000100:00100000:2.0:1787548835.808082:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+8:14361:x1874380431902080:12345-0@lo:101:mount.lustre.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548835.808088:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787548835.808211:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431902080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787548835.808222:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93a00/0xcb7c48919424f840 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f847 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548835.808230:0:14361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93a00/0xcb7c48919424f840 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424f847 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548835.808272:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431902208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787548835.808297:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548835.808577:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431902208 00000100:00100000:0.0:1787548835.808582:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431902208 00000100:00100000:1.0:1787548835.808663:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787548835.808670:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+8:14361:x1874380431902208:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787548835.809015:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+9:14361:x1874380431902208:12345-0@lo:501:mount.lustre.0 Request processed in 345us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548835.809022:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787548835.809073:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d2ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548835.809088:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431902208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787548835.809119:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431902336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787548835.809196:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548835.809212:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec988d0540 going to sleep for 11 seconds 00000100:00100000:0.0:1787548835.809275:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431902336 00000100:00100000:0.0:1787548835.809280:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431902336 00000100:00100000:0.0:1787548835.809300:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787548835.809307:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+9:14361:x1874380431902336:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787548835.809587:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+9:14361:x1874380431902336:12345-0@lo:503:mount.lustre.0 Request processed in 279us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548835.809593:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787548835.809676:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431902336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787548835.810320:0:14397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14397:1874380431902464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548835.810362:0:14397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548835.810434:0:14397:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec988d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548835.810470:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431902464 00000100:00100000:0.0:1787548835.810475:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431902464 00000100:00100000:0.0:1787548835.810542:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787548835.810550:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+9:14397:x1874380431902464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787548835.810794:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+9:14397:x1874380431902464:12345-0@lo:502:llog_process_th.0 Request processed in 244us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548835.810801:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787548835.810869:0:14397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14397:1874380431902464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787548835.810891:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548835.810900:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548835.810903:0:14397:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787548835.810907:0:14397:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787548835.810909:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787548835.810923:0:14397:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8feb811eb370) 00000020:00000080:1.0:1787548835.810939:0:14397:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787548835.810945:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787548835.811005:0:14397:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787548835.811012:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb7c48919424f855 00000020:00000080:1.0:1787548835.811277:0:14397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787548835.811282:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548835.811285:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548835.811286:0:14397:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787548835.811289:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548835.811293:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548835.811294:0:14397:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787548835.811297:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787548835.811305:0:14397:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8feb811e8000) 00000020:00000080:1.0:1787548835.811314:0:14397:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787548835.811319:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787548835.811321:0:14397:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787548835.811323:0:14397:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787548835.811329:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787548835.811366:0:14397:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fecba22b800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787548835.811379:0:14397:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8feb811ecd28) 00000020:00000080:1.0:1787548835.811387:0:14397:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787548835.811442:0:14397:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787548835.811447:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb7c48919424f86a 00000020:00000080:1.0:1787548835.811528:0:14397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787548835.811538:0:14397:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787548835.811543:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcb7c48919424f871 00080000:01000000:1.0:1787548835.811547:0:14397:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787548835.811550:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb7c48919424f878 00010000:00010000:3.0:1787548835.927822:0:14397:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787548835.928540:0:14397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787548835.928777:0:14397:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787548835.930119:0:14397:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8feb81f3b370) 00000020:00000080:3.0:1787548835.930152:0:14397:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787548835.930223:0:14397:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787548835.930229:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb7c48919424f886 00000020:00000080:3.0:1787548835.931205:0:14397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787548835.944387:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcb7c48919424f88d 00000020:00000080:1.0:1787548835.945334:0:14397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787548835.945345:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548835.945352:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548835.945355:0:14397:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787548835.945358:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548835.945363:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548835.945365:0:14397:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787548835.945369:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787548835.945407:0:14397:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787548835.945420:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548835.945423:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548835.945425:0:14397:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787548835.945428:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787548835.945430:0:14397:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787548835.945431:0:14397:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787548835.945433:0:14397:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787548835.945434:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787548835.945437:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548835.945438:0:14397:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787548835.945440:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787548835.945443:0:14397:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787548835.945447:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548835.945448:0:14397:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787548835.945451:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787548835.945456:0:14397:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.113@tcp to nid 0x20000c0a8ce71 (192.168.206.113@tcp) 00000020:01000000:1.0:1787548835.945481:0:14397:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787548835.945484:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787548835.945510:0:14397:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8fecb4863370) 00000020:00000080:1.0:1787548835.945524:0:14397:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787548835.945537:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787548835.946127:0:14397:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787548835.946148:0:14397:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787548835.946168:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb7c48919424f89b 00010000:00080000:1.0:1787548835.946200:0:14397:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fecad8a3000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.113@tcp at head 00010000:00010000:1.0:1787548835.946425:0:14397:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787548835.947554:0:14397:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787548835.947745:0:14397:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787548835.950776:0:14397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787548835.950848:0:14397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787548835.950916:0:14397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787548835.951551:0:14401:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787548835.951556:0:14401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787548835.952463:0:14397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787548835.952478:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787548835.952512:0:14397:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787548835.952530:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb7c48919424f8a2 00000100:00080000:3.0:1787548835.952540:0:14397:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787548835.952545:0:14397:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fecad8a3000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:3.0:1787548835.954125:0:14397:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecad560700 x1874380431902592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787548835.954240:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431902592:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787548835.954303:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874380431902592 offset 0 length 520: 4 00000100:00080000:3.0:1787548835.954368:0:14397:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787548835.954448:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787548835.954455:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548835.954457:0:14397:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787548835.954460:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787548835.954463:0:14397:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1787548835.954465:0:14397:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787548835.954466:0:14397:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787548835.954468:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787548835.954470:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548835.954471:0:14397:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787548835.954473:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787548835.954478:0:14397:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787548835.954481:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548835.954483:0:14397:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787548835.954486:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787548835.954489:0:14397:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.113@tcp to nid 0x20000c0a8ce71 (192.168.206.113@tcp) 00000020:01000000:3.0:1787548835.954511:0:14397:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787548835.954514:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787548835.954528:0:14397:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8feb81f399b8) 00000020:00000080:3.0:1787548835.954548:0:14397:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787548835.954553:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787548835.954748:0:14397:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787548835.954753:0:14397:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787548835.954765:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb7c48919424f8b0 00010000:00080000:3.0:1787548835.954793:0:14397:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fec8644e000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.113@tcp at head 00010000:00010000:3.0:1787548835.955100:0:14397:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787548835.955354:0:14397:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787548835.955375:0:14397:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787548835.956662:0:14397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787548835.956742:0:14397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787548835.956836:0:14397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787548835.957364:0:14403:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787548835.957369:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787548835.958367:0:14397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787548835.958379:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787548835.958410:0:14397:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787548835.958427:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb7c48919424f8b7 00000100:00080000:3.0:1787548835.958437:0:14397:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787548835.958442:0:14397:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fec8644e000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:3.0:1787548835.958476:0:14397:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecad562a00 x1874380431902720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787548835.958530:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431902720:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787548835.958594:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874380431902720 offset 0 length 520: 4 00000100:00080000:3.0:1787548835.958647:0:14397:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787548835.958702:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787548835.958706:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548835.958708:0:14397:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787548835.958711:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787548835.958716:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548835.958717:0:14397:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787548835.958720:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787548835.958722:0:14397:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787548835.958724:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787548835.958726:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548835.958728:0:14397:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787548835.958730:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787548835.958733:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548835.958734:0:14397:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787548835.958738:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787548835.958776:0:14397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14397:1874380431902848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548835.958825:0:14397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548835.958844:0:14397:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2d9c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548835.959097:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431902848 00000100:00100000:2.0:1787548835.959105:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431902848 00000100:00100000:3.0:1787548835.959468:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787548835.959478:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+9:14397:x1874380431902848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548835.959857:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+9:14397:x1874380431902848:12345-0@lo:502:llog_process_th.0 Request processed in 379us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548835.959866:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787548835.959947:0:14397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14397:1874380431902848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787548835.959976:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548835.959983:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548835.959984:0:14397:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787548835.959988:0:14397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787548835.960389:0:14361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1787548835.960408:0:14361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787548835.960461:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93a00/0xcb7c48919424f840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f847 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548835.960473:0:14361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93a00/0xcb7c48919424f840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f847 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548835.960481:0:14361:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fecba22b800 from 1 10000000:01000000:3.0:1787548835.960484:0:14361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787548835.960513:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548835.960521:0:14361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548835.960532:0:14361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548835.960548:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431902976:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787548835.960664:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548835.960738:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2d9c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548835.960796:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431902976 00000100:00100000:0.0:1787548835.960802:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431902976 00000100:00100000:0.0:1787548835.960861:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787548835.960869:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+9:14361:x1874380431902976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787548835.960878:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548835.960891:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90150e00/0xcb7c48919424f8c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424f8be expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548835.960909:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90150e00/0xcb7c48919424f8c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424f8be expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548835.960917:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90150e00/0xcb7c48919424f8c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f8be expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548835.960935:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150e00, rc 0) 00000100:00100000:0.0:1787548835.960975:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+10:14361:x1874380431902976:12345-0@lo:101:mount.lustre.0 Request processed in 106us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548835.960981:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787548835.961042:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431902976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787548835.961055:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f8c5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548835.961064:0:14361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424f8c5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548835.961634:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431903104:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787548835.961678:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548835.964583:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec861f60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787548835.964716:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431903104 00000100:00100000:3.0:1787548835.964725:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431903104 00000100:00100000:3.0:1787548835.964771:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787548835.964781:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+10:14361:x1874380431903104:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787548835.964807:0:14374:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787548835.964813:0:14374:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787548835.964941:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+10:14361:x1874380431903104:12345-0@lo:256:mount.lustre.0 Request processed in 161us (3261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548835.964961:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787548835.965103:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431903104:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787548835.965837:0:14361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787548835.965903:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f8c5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548835.965917:0:14361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f8c5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548835.965925:0:14361:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fecba22b800 from 1 10000000:01000000:1.0:1787548835.965929:0:14361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787548835.965970:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548835.965978:0:14361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548835.965988:0:14361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548835.966078:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431903232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787548835.966126:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548835.966183:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec861f60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548835.966361:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431903232 00000100:00100000:0.0:1787548835.966369:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431903232 00000100:00100000:0.0:1787548835.966403:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787548835.966410:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+10:14361:x1874380431903232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787548835.966422:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548835.966434:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90151a00/0xcb7c48919424f8d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424f8cc expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548835.966455:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90151a00/0xcb7c48919424f8d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424f8cc expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548835.966464:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90151a00/0xcb7c48919424f8d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f8cc expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548835.966472:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151a00, rc 0) 00000100:00100000:0.0:1787548835.966506:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:14361:x1874380431903232:12345-0@lo:101:mount.lustre.0 Request processed in 96us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548835.966513:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787548835.966858:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431903232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787548835.966872:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f8d3 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548835.966882:0:14361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424f8d3 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548835.966935:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431903360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787548835.966989:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548835.967122:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec861f60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548835.967257:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431903360 00000100:00100000:2.0:1787548835.967263:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431903360 00000100:00100000:0.0:1787548835.967337:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787548835.967346:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:14361:x1874380431903360:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787548835.967912:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:14361:x1874380431903360:12345-0@lo:501:mount.lustre.0 Request processed in 566us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548835.967933:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787548835.968029:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431903360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787548835.968068:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431903488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787548835.968112:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548835.968180:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec861f60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787548835.968333:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431903488 00000100:00100000:3.0:1787548835.968339:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431903488 00000100:00100000:3.0:1787548835.968364:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787548835.968372:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:14361:x1874380431903488:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787548835.968525:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:14361:x1874380431903488:12345-0@lo:503:mount.lustre.0 Request processed in 153us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548835.968532:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787548835.968769:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431903488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787548835.969269:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14405:1874380431903616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548835.969309:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548835.969341:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec861f6780 going to sleep for 11 seconds 00000100:00100000:3.0:1787548835.969442:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431903616 00000100:00100000:3.0:1787548835.969448:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431903616 00000100:00100000:3.0:1787548835.969480:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787548835.969488:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:14405:x1874380431903616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548835.969710:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:14405:x1874380431903616:12345-0@lo:502:llog_process_th.0 Request processed in 222us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548835.969718:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787548835.969866:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14405:1874380431903616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787548835.969891:0:14405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548835.969900:0:14405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548835.969903:0:14405:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787548835.969910:0:14405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fecba22b800 00000020:00000080:1.0:1787548835.969913:0:14405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787548835.969923:0:14405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548835.969925:0:14405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548835.969927:0:14405:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787548835.969929:0:14405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548835.969932:0:14405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548835.969934:0:14405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787548835.969937:0:14405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fecba22b800 00000020:00000080:1.0:1787548835.969940:0:14405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787548835.970810:0:14405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548835.970816:0:14405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548835.970818:0:14405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787548835.970822:0:14405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548835.970833:0:14405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548835.970835:0:14405:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787548835.970839:0:14405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fecba22b800 00000020:00000080:1.0:1787548835.970842:0:14405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787548835.970891:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14405:1874380431903744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787548835.971946:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548835.972264:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec861f6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787548835.972411:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431903744 00000100:00100000:0.0:1787548835.972420:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431903744 00000100:00100000:0.0:1787548835.972467:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787548835.972476:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:14405:x1874380431903744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787548835.972714:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:14405:x1874380431903744:12345-0@lo:502:llog_process_th.0 Request processed in 238us (1764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548835.972722:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787548835.972778:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14405:1874380431903744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787548835.972804:0:14405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787548835.972810:0:14405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548835.972812:0:14405:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787548835.972816:0:14405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787548835.976405:0:14361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787548835.976434:0:14361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787548835.976453:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f8d3 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548835.976466:0:14361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f8d3 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548835.976525:0:14361:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787548835.976528:0:14361:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fecba22b800 10000000:01000000:2.0:1787548835.976531:0:14361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fecba22b800 10000000:01000000:2.0:1787548835.976534:0:14361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787548835.976539:0:14361:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fecba22b800 from 1 10000000:01000000:2.0:1787548835.976542:0:14361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787548835.976579:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424f8da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548835.976587:0:14361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424f8da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548835.976597:0:14361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424f8da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548835.976621:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431903872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787548835.976692:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548835.976733:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8605a180 going to sleep for 11 seconds 00000100:00100000:0.0:1787548835.977958:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431903872 00000100:00100000:0.0:1787548835.977970:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431903872 00000100:00100000:0.0:1787548835.978034:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787548835.978045:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:14361:x1874380431903872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787548835.978061:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548835.978077:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90151000/0xcb7c48919424f8e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424f8da expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548835.978103:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90151000/0xcb7c48919424f8e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424f8da expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548835.978114:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90151000/0xcb7c48919424f8e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f8da expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548835.978149:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151000, rc 0) 00000100:00100000:0.0:1787548835.978218:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14361:x1874380431903872:12345-0@lo:101:mount.lustre.0 Request processed in 175us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548835.978225:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787548835.978482:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431903872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787548835.978499:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424f8da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f8e1 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548835.978507:0:14361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424f8da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424f8e1 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548835.978572:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431904000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787548835.978606:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548835.978642:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8605a180 going to sleep for 11 seconds 00000100:00100000:0.0:1787548835.978761:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431904000 00000100:00100000:0.0:1787548835.978766:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431904000 00000100:00100000:0.0:1787548835.979177:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787548835.979186:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14361:x1874380431904000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787548835.979428:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14361:x1874380431904000:12345-0@lo:501:mount.lustre.0 Request processed in 242us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548835.979436:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787548835.982913:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431904000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787548835.982995:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431904128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787548835.983198:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548835.983239:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8605a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787548835.983259:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431904128 00000100:00100000:2.0:1787548835.983265:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431904128 00000100:00100000:2.0:1787548835.983304:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787548835.983312:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14361:x1874380431904128:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787548835.983495:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14361:x1874380431904128:12345-0@lo:503:mount.lustre.0 Request processed in 182us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548835.983502:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787548835.983549:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431904128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787548835.984324:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14408:1874380431904256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787548835.984371:0:14408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548835.984430:0:14408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8605ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787548835.998127:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431904256 00000100:00100000:3.0:1787548835.998165:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431904256 00000100:00100000:3.0:1787548835.998216:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787548835.998225:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14408:x1874380431904256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548835.998474:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14408:x1874380431904256:12345-0@lo:502:llog_process_th.0 Request processed in 249us (14102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548835.998482:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787548835.998551:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14408:1874380431904256:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787548835.998608:0:14408:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787548835.998623:0:14408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8fecad890000) 00000020:00000080:3.0:1787548835.998640:0:14408:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787548835.998712:0:14408:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fecba22b800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787548835.998715:0:14408:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fecba22b800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787548835.998718:0:14408:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fecba22b800 4 00010000:00080000:3.0:1787548835.998743:0:14408:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fec8644c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.113@tcp at head 00010000:00010000:3.0:1787548836.004588:0:14408:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787548836.011091:0:14408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787548836.011150:0:14408:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787548836.011176:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcb7c48919424f8ef 00000100:00080000:3.0:1787548836.011188:0:14408:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787548836.011194:0:14408:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8fec8644c000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:3.0:1787548836.011233:0:14408:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecad560380 x1874380431904384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787548836.011262:0:14408:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787548836.011310:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874380431904384:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787548836.011379:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548836.012934:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad563800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14408:1874380431904512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548836.013005:0:14408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548836.013046:0:14408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca2d9c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787548836.013067:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431904512 00000100:00100000:3.0:1787548836.013073:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431904512 00000100:00100000:3.0:1787548836.013113:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787548836.013122:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14408:x1874380431904512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787548836.013398:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14408:x1874380431904512:12345-0@lo:502:llog_process_th.0 Request processed in 276us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548836.013406:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787548836.013464:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad563800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14408:1874380431904512:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787548836.013489:0:14408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787548836.013595:0:14361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787548836.013613:0:14361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:1.0:1787548836.013946:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431904384 00000100:00100000:1.0:1787548836.013952:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431904384 00000100:00100000:1.0:1787548836.013976:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548836.013983:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874380431904384:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787548836.014037:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874380431904384:12345-0@lo:38:llog_process_th.0 Request processed in 52us (2657us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787548836.014044:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548836.014094:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787548836.014101:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fec8644c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787548836.014106:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787548836.014109:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874380431904384:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1787548836.014865:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424f8da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f8e1 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548836.014880:0:14361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec813f6200/0xcb7c48919424f8da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f8e1 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787548836.014936:0:14361:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787548836.014938:0:14361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787548836.014939:0:14361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787548836.014940:0:14361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787548836.014941:0:14361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787548836.014943:0:14361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787548836.014945:0:14361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787548836.014946:0:14361:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787548836.014948:0:14361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787548836.014949:0:14361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787548836.014952:0:14361:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787548836.014955:0:14361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787548836.014956:0:14361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787548836.014962:0:14361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787548836.014963:0:14361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787548836.014964:0:14361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787548836.014965:0:14361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787548836.014965:0:14361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787548836.014966:0:14361:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787548836.014967:0:14361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787548836.014968:0:14361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787548836.014990:0:14361:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787548836.015005:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad563800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431904640:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787548836.015051:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548836.015082:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec90108300 going to sleep for 11 seconds 00000100:00100000:0.0:1787548836.015205:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431904640 00000100:00100000:0.0:1787548836.015211:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431904640 00000100:00100000:0.0:1787548836.015250:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787548836.015259:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14361:x1874380431904640:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787548836.015321:0:14373:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787548836.015338:0:14373:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787548836.074558:0:14373:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787548836.074575:0:14373:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787548836.074711:0:14395:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787548836.074716:0:14395:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787548836.074739:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548836.074768:0:14395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec90150e00/0xcb7c48919424f8c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f8be expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548836.074777:0:14395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548836.074816:0:14395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec90150e00/0xcb7c48919424f8c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424f8be expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548836.074841:0:14395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fec90150e00/0xcb7c48919424f8c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424f8be expref: 12 pid: 14373 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548836.074855:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14395:1874380431904768:0@lo:104: 00000100:00100000:2.0:1787548836.074924:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548836.074978:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d76840 going to sleep for 11 seconds 00000100:00100000:1.0:1787548836.075103:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431904768 00000100:00100000:1.0:1787548836.075111:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431904768 00000100:00100000:1.0:1787548836.075178:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548836.075187:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+3:14395:x1874380431904768:12345-0@lo:104: 00010000:00010000:1.0:1787548836.075200:0:14362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424f8c5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075246:0:14362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787548836.075251:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+3:14395:x1874380431904768:12345-0@lo:104: Request processed in 66us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548836.075266:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787548836.075285:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548836.075291:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424f8c5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075297:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92400 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:1.0:1787548836.075301:0:14368:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424f8c5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075310:0:14368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424f8c5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548836.075317:0:14368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424f8c5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548836.075322:0:14368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787548836.075345:0:14368:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f8c5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075351:0:14368:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548836.075368:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f8c5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075375:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424f8be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f8c5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075389:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548836.075391:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548836.075392:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548836.075416:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431904896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787548836.075445:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548836.075489:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431904896 00000100:00100000:1.0:1787548836.075492:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431904896 00010000:00010000:1.0:1787548836.075506:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec90150e00/0xcb7c48919424f8c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424f8be expref: 13 pid: 14373 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548836.075524:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548836.075529:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+13:3315:x1874380431904896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787548836.075537:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548836.075542:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec90150e00/0xcb7c48919424f8c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424f8be expref: 13 pid: 14373 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075552:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec90150e00/0xcb7c48919424f8c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424f8be expref: 13 pid: 14373 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075565:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075573:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787548836.075584:0:14364:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000868517s 00010000:00010000:1.0:1787548836.075588:0:14364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075595:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075601:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075617:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075631:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec813f6000 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548836.075635:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075642:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075650:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075659:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548836.075684:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+13:3315:x1874380431904896:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548836.075690:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548836.075719:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431904896:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787548836.075738:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec90150e00/0xcb7c48919424f8c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424f8be expref: 12 pid: 14373 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548836.075746:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14395:1874380431904768:0@lo:104: 00010000:00010000:1.0:1787548836.075777:0:14395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075786:0:14395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075801:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.075808:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec813f6000/0xcb7c48919424f8f6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548836.084076:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:14361:x1874380431904640:12345-0@lo:253:mount.lustre.0 Request processed in 68807us (69014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548836.084091:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787548836.084271:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad563800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14361:1874380431904640:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787548836.084287:0:14361:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787548836.084290:0:14361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787548836.084292:0:14361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787548836.084293:0:14361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787548836.084294:0:14361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787548836.084296:0:14361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787548836.084297:0:14361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787548836.084298:0:14361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787548836.084300:0:14361:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787548836.084309:0:14361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787548836.084311:0:14361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787548836.084326:0:14361:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787548836.090906:0:14361:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787548836.091079:0:14361:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787548836.091710:0:14361:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787548836.091961:0:14361:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787548836.092381:0:14361:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787548836.092544:0:14361:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787548836.093841:0:14361:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548836.093990:0:14361:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787548836.094292:0:14361:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548836.094594:0:14361:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787548836.095082:0:14361:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548836.095452:0:14361:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1787548836.121591:0:14361:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787548836.122068:0:14361:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787548836.122459:0:14418:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787548836.122465:0:14418:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1787548836.122541:0:14419:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1787548836.122620:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787548836.125527:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787548836.125607:0:14419:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787548836.125611:0:14419:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1787548836.129452:0:14361:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787548836.129588:0:14361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787548836.130276:0:14361:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787548836.130286:0:14361:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787548836.130532:0:14361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787548836.131882:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787548836.132705:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787548836.132745:0:14361:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787548836.135006:0:14361:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787548836.144095:0:14361:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787548836.198099:0:14361:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787548836.198163:0:14361:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb7704181b988 00100000:10000000:3.0:1787548836.198172:0:14361:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787548836.199294:0:14361:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787548836.199406:0:14361:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787548836.199420:0:14361:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787548836.199438:0:14361:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787548836.483948:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787548836.741675:0:14377:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787548836.741683:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fecba22b800 from 6 10000000:01000000:1.0:1787548836.741689:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787548836.741736:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.741748:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548836.741758:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548836.741788:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431905024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787548836.741860:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548836.741915:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8613dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787548836.741989:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431905024 00000100:00100000:0.0:1787548836.741997:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431905024 00000100:00100000:0.0:1787548836.742050:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787548836.742060:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:14377:x1874380431905024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787548836.742072:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548836.742091:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90150400/0xcb7c48919424f904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424f8fd expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548836.742113:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90150400/0xcb7c48919424f904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424f8fd expref: 12 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548836.742123:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90150400/0xcb7c48919424f904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f8fd expref: 12 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548836.742167:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150400, rc 0) 00000100:00100000:0.0:1787548836.742210:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14377:x1874380431905024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548836.742217:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787548836.742260:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431905024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787548836.742274:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f904 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548836.742282:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424f904 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548836.742329:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431905152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787548836.742360:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548836.742378:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85cd10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548836.742434:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431905152 00000100:00100000:1.0:1787548836.742439:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431905152 00000100:00100000:1.0:1787548836.742469:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787548836.742476:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14377:x1874380431905152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787548836.742488:0:14371:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787548836.742501:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787548836.742505:0:14371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787548836.742577:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14377:x1874380431905152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548836.742584:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787548836.742655:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431905152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787548836.742693:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787548836.742699:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f904 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548836.742715:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f904 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787548837.062669:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787548837.507482:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787548838.085403:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787548838.531445:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548839.560497:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548840.579411:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787548841.271492:0:14662:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg613-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1787548841.475730:0:12905:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787548841.475738:0:12905:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787548841.475740:0:12905:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787548841.475743:0:12905:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787548841.475746:0:12905:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787548841.475749:0:12905:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787548841.475753:0:12905:0:(import.c:65:import_set_state_nolock()) ffff8fec8644c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787548841.475765:0:12905:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8fec8644c000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:1.0:1787548841.475790:0:12905:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fec8833f480 x1874380431905408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787548841.475846:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3316:1874380431905280:0@lo:400:kworker.0 00000100:00100000:1.0:1787548841.475990:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548841.476058:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874380431905408:0@lo:38:kworker.0 00000100:00100000:0.0:1787548841.476073:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431905280 00000100:00100000:0.0:1787548841.476082:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431905280 00000100:00100000:1.0:1787548841.476084:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548841.476122:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431905408 00000100:00100000:0.0:1787548841.476122:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787548841.476152:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431905408 00000100:00100000:0.0:1787548841.476158:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:3316:x1874380431905280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548841.476209:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:3316:x1874380431905280:12345-0@lo:400:kworker.0 Request processed in 52us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548841.476216:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787548841.476251:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548841.476257:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1874380431905408:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787548841.476279:0:14381:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:1.0:1787548841.476315:0:14381:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcb7c48919424f90b 00000004:00100000:1.0:1787548841.476329:0:14381:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787548841.476513:0:14381:0:(import.c:65:import_set_state_nolock()) ffff8fecbcb62000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787548841.476564:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874380431905408:12345-0@lo:38:kworker.0 Request processed in 305us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548841.476570:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548841.476688:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3316:1874380431905280:0@lo:400:kworker.0 00010000:00080000:0.0:1787548841.477037:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fec8833f480 x1874380431905408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787548851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787548841.477050:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787548841.477056:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787548841.477061:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787548841.477063:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fec8644c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787548841.477068:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874380431905408:0@lo:38:kworker.0 00010000:00010000:2.0:1787548841.614952:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548842.628831:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548843.651425:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548844.677864:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787548844.742016:0:14814:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffddac011c0 20000000:00000080:3.0:1787548844.742042:0:14814:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fecb49ec800 uarg=0000000000000000 20000000:01000000:3.0:1787548844.742085:0:14814:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787548844.742094:0:14814:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787548844.742100:0:14814:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787548844.743395:0:14815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787548844.743763:0:14814:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787548844.764900:0:14814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787548844.765089:0:14814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548844.765125:0:14814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec90151a00/0xcb7c48919424f8d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f8cc expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548844.765311:0:14814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548844.765370:0:14814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec90151a00/0xcb7c48919424f8d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424f8cc expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548844.765388:0:14814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fec90151a00/0xcb7c48919424f8d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424f8cc expref: 11 pid: 14373 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548844.765406:0:14814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad563800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14814:1874380431905536:0@lo:104: 00000100:00100000:3.0:1787548844.765504:0:14814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548844.765572:0:14814:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8605ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787548844.765668:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431905536 00000100:00100000:2.0:1787548844.765678:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431905536 00000100:00100000:2.0:1787548844.765739:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787548844.765750:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad562d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+3:14814:x1874380431905536:12345-0@lo:104: 00010000:00010000:2.0:1787548844.765766:0:14363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424f8d3 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548844.765833:0:14363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787548844.765845:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad562d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+3:14814:x1874380431905536:12345-0@lo:104: Request processed in 97us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548844.765853:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787548844.765882:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548844.765889:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424f8d3 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548844.765898:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fa00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:2.0:1787548844.765902:0:14368:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424f8d3 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548844.765912:0:14368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424f8d3 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787548844.765920:0:14368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424f8d3 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548844.765927:0:14368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787548844.765962:0:14368:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f8d3 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548844.765969:0:14368:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787548844.766000:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f8d3 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548844.766007:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecbd22fa00/0xcb7c48919424f8cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f8d3 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548844.766025:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548844.766028:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548844.766030:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548844.766198:0:14814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad563800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14814:1874380431905536:0@lo:104: 00010000:00010000:0.0:1787548844.766223:0:14814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548844.766534:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787548844.766548:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3314:1874380431905664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787548844.766590:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548844.766729:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431905664 00000100:00100000:0.0:1787548844.766736:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431905664 00010000:00010000:0.0:1787548844.766762:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec90151a00/0xcb7c48919424f8d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424f8cc expref: 12 pid: 14373 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548844.766789:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787548844.766797:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad562300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:3314:x1874380431905664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787548844.766810:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548844.766816:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec90151a00/0xcb7c48919424f8d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424f8cc expref: 12 pid: 14373 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548844.766828:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec90151a00/0xcb7c48919424f8d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424f8cc expref: 12 pid: 14373 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548844.766844:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec90151a00/0xcb7c48919424f8d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424f8cc expref: 12 pid: 14373 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548844.766862:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548844.766871:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548844.766886:0:14364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548844.766894:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548844.766901:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548844.766916:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548844.766921:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93c00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548844.766926:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548844.766933:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548844.766957:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548844.766967:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787548844.767021:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad562300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:3314:x1874380431905664:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548844.767029:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787548844.767462:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3314:1874380431905664:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787548844.767504:0:14814:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548844.767513:0:14814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548844.767519:0:14814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f912 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548845.579241:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787548835/real 1787548835] req@ffff8fecad562a00 x1874380431902720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787548845 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548845.579281:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fecad562a00 x1874380431902720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787548845 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548845.579292:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787548835/real 1787548835] req@ffff8fecad560700 x1874380431902592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787548845 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548845.579305:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fecad560700 x1874380431902592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787548845 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787548845.579325:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fec8644e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787548845.579364:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787548845.579369:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431902720:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787548845.579375:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fecad8a3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787548845.579381:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787548845.579383:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431902592:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787548845.579935:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787548845.579941:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787548845.579944:0:38:0:(import.c:65:import_set_state_nolock()) ffff8fecad8a3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787548845.579950:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:0.0:1787548845.579956:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787548845.579963:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fecad8a3000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:0.0:1787548845.579987:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecb51cc000 x1874380431905920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787548845.580013:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787548845.580016:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787548845.580031:0:38:0:(import.c:65:import_set_state_nolock()) ffff8fec8644e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787548845.580035:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:0.0:1787548845.580038:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787548845.580042:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fec8644e000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:0.0:1787548845.580055:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecb51ce300 x1874380431906048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787548845.580100:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787548845.580126:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3313:1874380431905792:0@lo:400:kworker.0 00000100:00100000:0.0:1787548845.580245:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548845.580334:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431906176:0@lo:400:kworker.0 00000100:00100000:0.0:1787548845.580365:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548845.580429:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431905792 00000100:00100000:0.0:1787548845.580440:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431905792 00000100:00100000:0.0:1787548845.580498:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787548845.580509:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:3313:x1874380431905792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548845.580568:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:3313:x1874380431905792:12345-0@lo:400:kworker.0 Request processed in 61us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548845.580576:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787548845.580622:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431906176 00000100:00100000:0.0:1787548845.580626:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431906176 00000100:00100000:0.0:1787548845.580649:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787548845.580655:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431906176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548845.580690:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431906176:12345-0@lo:400:kworker.0 Request processed in 35us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548845.580696:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787548845.580733:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fecb51cce00 x1874380431906176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548845.580759:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431906176:0@lo:400:kworker.0 00000100:00100000:0.0:1787548845.580791:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3313:1874380431905792:0@lo:400:kworker.0 00000100:00100000:0.0:1787548845.580808:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431905920:0@lo:8:kworker.0 00000400:00000100:0.0:1787548845.580840:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874380431905920 offset 0 length 520: 4 00000100:00100000:0.0:1787548845.580855:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431906048:0@lo:8:kworker.0 00000400:00000100:0.0:1787548845.580875:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874380431906048 offset 0 length 520: 4 00010000:00010000:0.0:1787548845.706185:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548846.723574:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787548846.788822:0:14377:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787548846.788831:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fecba22b800 from 10 10000000:01000000:1.0:1787548846.788838:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787548846.788899:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548846.788912:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548846.788934:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548846.788967:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431906304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787548846.789060:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548846.789175:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431906304 00000100:00100000:2.0:1787548846.789186:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431906304 00000100:00100000:1.0:1787548846.789277:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8613de40 going to sleep for 11 seconds 00000100:00100000:3.0:1787548846.789504:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787548846.789518:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+11:14377:x1874380431906304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787548846.789535:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548846.789556:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f920 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424f919 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548846.789584:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424f919 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548846.789596:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f919 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548846.789607:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93c00, rc 0) 00000100:00100000:3.0:1787548846.789665:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14377:x1874380431906304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548846.789685:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787548846.789776:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431906304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548846.789794:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f920 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548846.789804:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424f920 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548846.789873:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431906432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548846.789914:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548846.794673:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ece40 going to sleep for 11 seconds 00000100:00100000:1.0:1787548846.794823:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431906432 00000100:00100000:1.0:1787548846.794835:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431906432 00000100:00100000:1.0:1787548846.794900:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787548846.794913:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14377:x1874380431906432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787548846.795401:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14377:x1874380431906432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 489us (5484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548846.795411:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787548846.797881:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431906432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548846.797970:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431906560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787548846.798065:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548846.798152:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431906560 00000100:00100000:2.0:1787548846.798160:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431906560 00000100:00100000:2.0:1787548846.798226:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787548846.798237:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14377:x1874380431906560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787548846.798464:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:14377:x1874380431906560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548846.798473:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787548846.798535:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ece40 going to sleep for 11 seconds 00000100:00100000:2.0:1787548846.798550:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431906560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787548846.799288:0:14889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787548846.799365:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787548846.799386:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787548846.799400:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f920 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548846.799411:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f920 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548847.748215:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787548848.324776:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787548848.774024:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548849.795267:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787548850.460468:0:15062:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787548850.460474:0:15062:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787548850.460651:0:15062:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fec88490800 00000020:01000004:3.0:1787548850.460670:0:15062:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787548850.460685:0:15062:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787548850.460702:0:15062:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8fecad894d28) 00000020:00000080:3.0:1787548850.460724:0:15062:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787548850.498592:0:15062:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787548850.502432:0:15062:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787548850.505594:0:15062:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787548850.506104:0:15062:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787548850.506439:0:15062:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787548850.507607:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1787548850.507897:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1787548850.508235:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1787548850.508697:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 337: rc = 0 00100000:10000000:2.0:1787548850.509512:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 337: rc = 0 00100000:10000000:2.0:1787548850.512350:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 337: rc = 0 00100000:10000000:2.0:1787548850.515877:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 337: rc = 0 00100000:10000000:3.0:1787548850.516826:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 337: rc = 0 00100000:10000000:3.0:1787548850.517430:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 337: rc = 0 00000020:00000080:3.0:1787548850.522100:0:15062:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787548850.522122:0:15062:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787548850.522241:0:15062:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcb7c48919424f92e 00000020:01000004:3.0:1787548850.522253:0:15062:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787548850.522282:0:15062:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787548850.522286:0:15062:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787548850.522294:0:15062:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787548850.522299:0:15062:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787548850.522316:0:15062:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8fecad893370) 00000020:00000080:3.0:1787548850.522334:0:15062:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787548850.540261:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787548850.540544:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787548850.540551:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787548850.541588:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787548850.541602:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787548850.542358:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787548850.542368:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787548850.554711:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787548850.554964:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787548850.556928:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787548850.558400:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787548850.558415:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787548850.595595:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787548850.598346:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787548850.598363:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787548850.604862:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787548850.604887:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787548850.607702:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787548850.607721:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787548850.609936:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787548850.610119:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787548850.610125:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787548850.611740:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787548850.611752:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00080000:1.0:1787548850.691494:0:12905:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787548850.691501:0:12905:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787548850.691504:0:12905:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787548850.691507:0:12905:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787548850.691587:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431906816:0@lo:400:kworker.0 00000100:00100000:1.0:1787548850.691663:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548850.691763:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431906816 00000100:00100000:1.0:1787548850.691773:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431906816 00000100:00100000:1.0:1787548850.691818:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548850.691827:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431906816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548850.691880:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431906816:12345-0@lo:400:kworker.0 Request processed in 54us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548850.691886:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787548850.692038:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fec8833c700 x1874380431906816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548850.692051:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431906816:0@lo:400:kworker.0 00000100:00100000:3.0:1787548850.692419:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787548850.692443:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431906688:0@lo:400:kworker.0 00000100:00100000:3.0:1787548850.692482:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548850.692710:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431906688 00000100:00100000:1.0:1787548850.692716:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431906688 00000100:00100000:1.0:1787548850.692788:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787548850.692806:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:3315:x1874380431906688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548850.692859:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:3315:x1874380431906688:12345-0@lo:400:kworker.0 Request processed in 63us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548850.692866:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787548850.694683:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431906688:0@lo:400:kworker.0 00000100:00100000:2.0:1787548850.703431:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787548850.703729:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787548850.703736:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787548850.705705:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787548850.705718:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787548850.706298:0:15062:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787548850.706323:0:15062:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787548850.706328:0:15062:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787548850.741567:0:15062:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787548850.741606:0:15062:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.113@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787548850.741611:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787548850.741613:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787548850.741614:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787548850.741615:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787548850.741617:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787548850.741618:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787548850.741619:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787548850.741621:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787548850.741623:0:15062:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787548850.741626:0:15062:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787548850.741628:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787548850.741630:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787548850.741634:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787548850.741635:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787548850.741636:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787548850.741638:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787548850.741639:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787548850.741640:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787548850.741641:0:15062:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787548850.741666:0:15062:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787548850.741685:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431906944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787548850.741772:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548850.741945:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec000 going to sleep for 11 seconds 00000100:00100000:0.0:1787548850.744489:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431906944 00000100:00100000:0.0:1787548850.744506:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431906944 00000100:00100000:0.0:1787548850.745274:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787548850.745291:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:15062:x1874380431906944:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787548850.745329:0:14371:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787548850.745333:0:14371:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787548850.745337:0:14371:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787548850.778737:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:15062:x1874380431906944:12345-0@lo:253:mount.lustre.0 Request processed in 33442us (36955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548850.778753:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787548850.778778:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431906944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787548850.778793:0:15062:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787548850.778807:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787548850.778809:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787548850.778810:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787548850.778812:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787548850.778813:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787548850.778814:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787548850.778816:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787548850.778817:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787548850.778818:0:15062:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787548850.778839:0:15062:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fec88490800 from lustre-OST0000 10000000:01000000:2.0:1787548850.778869:0:15062:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787548850.778872:0:15062:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787548850.778879:0:15062:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8feb811e99b8 local copy 00010000:00010000:2.0:1787548850.778890:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92c00/0xcb7c48919424f824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f82b expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548850.779617:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787548850.779654:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548850.779691:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec300 going to sleep for 11 seconds 00000100:00100000:1.0:1787548850.780092:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431907072 00000100:00100000:1.0:1787548850.780100:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431907072 00000100:00100000:1.0:1787548850.780175:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787548850.780184:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:15062:x1874380431907072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787548850.780392:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:15062:x1874380431907072:12345-0@lo:501:mount.lustre.0 Request processed in 208us (736us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787548850.780410:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787548850.781849:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907072:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787548850.781889:0:15062:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787548850.782273:0:15062:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787548850.782285:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92c00/0xcb7c48919424f824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f82b expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.782296:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92c00/0xcb7c48919424f824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f82b expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548850.782327:0:15062:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fec88490800 10000000:01000000:2.0:1787548850.782333:0:15062:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787548850.782337:0:15062:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8feb811e99b8 10000000:01000000:2.0:1787548850.782340:0:15062:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787548850.782344:0:15062:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8feb811e99b8 from 1 10000000:01000000:2.0:1787548850.782347:0:15062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787548850.782381:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f6000/0xcb7c48919424f93c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.782390:0:15062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec813f6000/0xcb7c48919424f93c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.782401:0:15062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec813f6000/0xcb7c48919424f93c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548850.782422:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787548850.782490:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548850.782535:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec300 going to sleep for 11 seconds 00000100:00100000:1.0:1787548850.782656:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431907200 00000100:00100000:1.0:1787548850.782664:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431907200 00000100:00100000:1.0:1787548850.782722:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787548850.782732:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+12:15062:x1874380431907200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787548850.782746:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548850.782761:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424f943 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424f93c expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.782782:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424f943 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424f93c expref: 13 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.782792:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbd22f600/0xcb7c48919424f943 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f93c expref: 13 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.782800:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22f600, rc 0) 00000100:00100000:1.0:1787548850.782843:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+13:15062:x1874380431907200:12345-0@lo:101:mount.lustre.0 Request processed in 112us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548850.782849:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787548850.784356:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787548850.784380:0:15062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec813f6000/0xcb7c48919424f93c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f943 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.784407:0:15062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec813f6000/0xcb7c48919424f93c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424f943 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548850.784431:0:15062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787548850.784456:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f6000/0xcb7c48919424f93c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f943 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.784463:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec813f6000/0xcb7c48919424f93c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f943 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548850.784472:0:15062:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787548850.784477:0:15062:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787548850.784482:0:15062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787548850.784485:0:15062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787548850.784511:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f7600/0xcb7c48919424f94a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.784518:0:15062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec813f7600/0xcb7c48919424f94a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.784526:0:15062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec813f7600/0xcb7c48919424f94a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548850.784543:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787548850.784593:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548850.784637:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec300 going to sleep for 11 seconds 00000100:00100000:1.0:1787548850.785234:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431907328 00000100:00100000:1.0:1787548850.785242:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431907328 00000100:00100000:1.0:1787548850.785298:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787548850.785308:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+13:15062:x1874380431907328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787548850.785322:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548850.785336:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbd22e000/0xcb7c48919424f951 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424f94a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.785358:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbd22e000/0xcb7c48919424f951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424f94a expref: 14 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.785377:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbd22e000/0xcb7c48919424f951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f94a expref: 14 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.785386:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22e000, rc 0) 00000100:00100000:1.0:1787548850.785441:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+14:15062:x1874380431907328:12345-0@lo:101:mount.lustre.0 Request processed in 135us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548850.785448:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787548850.788180:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907328:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787548850.788211:0:15062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec813f7600/0xcb7c48919424f94a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f951 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.789690:0:15062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec813f7600/0xcb7c48919424f94a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424f951 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787548850.791312:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787548850.798992:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787548850.806714:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787548850.808065:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787548850.808350:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787548850.808427:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787548850.808465:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787548850.808498:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787548850.808577:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787548850.808585:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787548850.808696:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787548850.808764:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548850.809093:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431907456 00000100:00100000:3.0:1787548850.809101:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431907456 00000100:00100000:3.0:1787548850.809173:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787548850.809184:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+14:15062:x1874380431907456:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787548850.809563:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+14:15062:x1874380431907456:12345-0@lo:501:mount.lustre.0 Request processed in 380us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548850.809572:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787548850.812395:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8a928f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787548850.812441:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787548850.812505:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907584:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787548850.813032:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548850.813160:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8a928f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787548850.814912:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431907584 00000100:00100000:0.0:1787548850.814926:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431907584 00000100:00100000:0.0:1787548850.815051:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787548850.815063:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+14:15062:x1874380431907584:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787548850.815700:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+14:15062:x1874380431907584:12345-0@lo:503:mount.lustre.0 Request processed in 637us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548850.815711:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787548850.816064:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907584:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787548850.816978:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787548850.817063:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787548850.817191:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548850.817238:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431907712 00000100:00100000:3.0:1787548850.817245:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431907712 00000100:00100000:3.0:1787548850.817290:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787548850.817298:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+14:15062:x1874380431907712:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787548850.817555:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+14:15062:x1874380431907712:12345-0@lo:502:mount.lustre.0 Request processed in 257us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548850.817562:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787548850.817670:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9008b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787548850.817690:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787548850.818068:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787548850.818182:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787548850.818221:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787548850.820665:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787548850.820711:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787548850.820747:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787548850.820796:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787548850.820833:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787548850.820867:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787548850.820914:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787548850.820947:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787548850.820998:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787548850.821047:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787548850.821180:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548850.821220:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9008b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787548850.823007:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431907840 00000100:00100000:2.0:1787548850.823022:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431907840 00000100:00100000:2.0:1787548850.823102:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787548850.823114:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+14:15062:x1874380431907840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787548850.823442:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+14:15062:x1874380431907840:12345-0@lo:502:mount.lustre.0 Request processed in 330us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548850.823450:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787548850.823491:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787548850.823621:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787548850.823638:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00010000:00010000:1.0:1787548850.823740:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787548850.825658:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787548850.825669:0:15077:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787548850.825676:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548850.825678:0:15077:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787548850.825683:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787548850.825708:0:15077:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8fecad8919b8) 00000020:00000080:3.0:1787548850.825734:0:15077:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787548850.825741:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787548850.825840:0:15077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fec88490800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787548850.825849:0:15077:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787548850.825858:0:15077:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcb7c48919424f95f 00010000:00010000:3.0:1787548850.831878:0:15077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787548850.832358:0:15077:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787548850.838018:0:15077:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787548850.841034:0:15077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787548850.841048:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548850.841054:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548850.841056:0:15077:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787548850.841060:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787548850.841062:0:15077:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787548850.841064:0:15077:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787548850.841066:0:15077:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787548850.841067:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787548850.841069:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548850.841071:0:15077:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787548850.841087:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548850.841099:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548850.841101:0:15077:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787548850.841105:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787548850.841106:0:15077:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787548850.841109:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548850.841111:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548850.841112:0:15077:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787548850.841115:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548850.841117:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548850.841118:0:15077:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787548850.841121:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787548850.841221:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548850.841225:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548850.841227:0:15077:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787548850.841230:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787548850.842481:0:15062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787548850.842519:0:15062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787548850.842546:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f7600/0xcb7c48919424f94a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f951 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548850.842559:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec813f7600/0xcb7c48919424f94a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f951 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548850.842568:0:15062:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fec88490800 from 1 10000000:01000000:3.0:1787548850.842570:0:15062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787548850.842609:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548850.842617:0:15062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548850.842630:0:15062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548850.842660:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787548850.842729:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548850.842771:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd4b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548850.843023:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431907968 00000100:00100000:1.0:1787548850.843031:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431907968 00000100:00100000:1.0:1787548850.843092:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787548850.843102:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+14:15062:x1874380431907968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787548850.843116:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548850.843152:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbd22f200/0xcb7c48919424f96d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424f966 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.843174:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbd22f200/0xcb7c48919424f96d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424f966 expref: 15 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.843185:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbd22f200/0xcb7c48919424f96d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f966 expref: 15 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.843193:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbd22f200, rc 0) 00000100:00100000:1.0:1787548850.843237:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+15:15062:x1874380431907968:12345-0@lo:101:mount.lustre.0 Request processed in 137us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548850.843254:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787548850.843344:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431907968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787548850.843359:0:15062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f96d expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548850.843368:0:15062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424f96d expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787548850.851233:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787548850.851678:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787548850.851943:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787548850.852002:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787548850.852070:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787548850.852093:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787548850.852193:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787548850.852256:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548850.852296:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9008bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787548850.852701:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431908096 00000100:00100000:0.0:1787548850.852709:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431908096 00000100:00100000:0.0:1787548850.852761:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787548850.852771:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+15:15062:x1874380431908096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787548850.853005:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+15:15062:x1874380431908096:12345-0@lo:501:mount.lustre.0 Request processed in 235us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548850.853012:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787548850.853127:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787548850.854957:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787548850.855028:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548850.855069:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9008bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787548850.855607:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431908224 00000100:00100000:0.0:1787548850.855618:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431908224 00000100:00100000:0.0:1787548850.855699:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787548850.855709:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+15:15062:x1874380431908224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787548850.855933:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+15:15062:x1874380431908224:12345-0@lo:503:mount.lustre.0 Request processed in 225us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548850.855941:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787548850.856028:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908224:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787548850.856577:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787548850.856656:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908352:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787548850.856708:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548850.865962:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9008bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787548850.866325:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431908352 00000100:00100000:2.0:1787548850.866337:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431908352 00000100:00100000:2.0:1787548850.866390:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787548850.866400:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+15:15062:x1874380431908352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787548850.866675:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+15:15062:x1874380431908352:12345-0@lo:502:mount.lustre.0 Request processed in 276us (9966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548850.866683:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787548850.866805:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787548850.867166:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787548850.867218:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787548850.867284:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787548850.867323:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787548850.867352:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787548850.867391:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787548850.867433:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787548850.867458:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787548850.867493:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787548850.867546:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548850.867578:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec9008bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787548850.868592:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431908480 00000100:00100000:2.0:1787548850.868602:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431908480 00000100:00100000:2.0:1787548850.868646:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787548850.868656:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+15:15062:x1874380431908480:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787548850.868904:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+15:15062:x1874380431908480:12345-0@lo:502:mount.lustre.0 Request processed in 248us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548850.868912:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787548850.869064:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787548850.869238:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787548850.869252:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787548850.873036:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548850.873051:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548850.873054:0:15081:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787548850.873061:0:15081:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fec88490800 00000020:00000080:1.0:1787548850.873063:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787548850.873070:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548850.873083:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548850.873085:0:15081:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787548850.873088:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548850.873091:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548850.873093:0:15081:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787548850.873096:0:15081:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fec88490800 00000020:00000080:1.0:1787548850.873098:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787548850.873177:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548850.873182:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548850.873183:0:15081:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787548850.873186:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787548850.873188:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548850.873189:0:15081:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787548850.873193:0:15081:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fec88490800 00000020:00000080:1.0:1787548850.873195:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787548850.873230:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787548850.873234:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787548850.873235:0:15081:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787548850.873251:0:15081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787548850.887706:0:15062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787548850.887750:0:15062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787548850.887776:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f96d expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.887788:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f96d expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548850.887854:0:15062:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787548850.887857:0:15062:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fec88490800 10000000:01000000:2.0:1787548850.887860:0:15062:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fec88490800 10000000:01000000:2.0:1787548850.887874:0:15062:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787548850.887880:0:15062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fec88490800 from 1 10000000:01000000:2.0:1787548850.887883:0:15062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787548850.887919:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f6a00/0xcb7c48919424f974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.887928:0:15062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec813f6a00/0xcb7c48919424f974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.887938:0:15062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec813f6a00/0xcb7c48919424f974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548850.887961:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908608:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787548850.888021:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548850.888060:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431908608 00000100:00100000:2.0:1787548850.888066:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431908608 00000100:00100000:2.0:1787548850.888117:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787548850.888126:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+15:15062:x1874380431908608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787548850.888159:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548850.888177:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec813f7a00/0xcb7c48919424f97b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424f974 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.888200:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec813f7a00/0xcb7c48919424f97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424f974 expref: 16 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.888210:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec813f7a00/0xcb7c48919424f97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f974 expref: 16 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.888219:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec813f7a00, rc 0) 00000100:00100000:2.0:1787548850.888268:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15062:x1874380431908608:12345-0@lo:101:mount.lustre.0 Request processed in 130us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548850.888275:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787548850.888319:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec881ebcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548850.888339:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787548850.888353:0:15062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec813f6a00/0xcb7c48919424f974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f97b expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.888363:0:15062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec813f6a00/0xcb7c48919424f974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424f97b expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787548850.888895:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787548850.889390:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787548850.889622:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787548850.889666:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787548850.902229:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787548850.902372:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787548850.902405:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787548850.902482:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787548850.902517:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787548850.902561:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787548850.902618:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787548850.902657:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787548850.902691:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787548850.902743:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787548850.902780:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787548850.902812:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787548850.902861:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787548850.902899:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787548850.902935:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787548850.902985:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787548850.903019:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787548850.903048:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787548850.903101:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787548850.903185:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787548850.903222:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787548850.903276:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787548850.903315:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787548850.903344:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787548850.903387:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787548850.903421:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787548850.903509:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787548850.903517:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787548850.903618:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787548850.903689:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548850.903728:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec881ebcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787548850.903857:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431908736 00000100:00100000:3.0:1787548850.903865:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431908736 00000100:00100000:3.0:1787548850.903907:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787548850.903917:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15062:x1874380431908736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787548850.904171:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15062:x1874380431908736:12345-0@lo:501:mount.lustre.0 Request processed in 254us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548850.904179:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787548850.904651:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787548850.904689:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908864:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787548850.904734:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548850.904764:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec881ebcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548850.905166:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431908864 00000100:00100000:0.0:1787548850.905172:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431908864 00000100:00100000:0.0:1787548850.905207:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787548850.905215:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15062:x1874380431908864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787548850.905387:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15062:x1874380431908864:12345-0@lo:503:mount.lustre.0 Request processed in 172us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548850.905394:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787548850.906758:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908864:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787548850.907381:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787548850.907462:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787548850.907521:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548850.907557:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8602d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787548850.907614:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431908992 00000100:00100000:0.0:1787548850.907621:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431908992 00000100:00100000:0.0:1787548850.907669:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787548850.907677:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15062:x1874380431908992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787548850.907876:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15062:x1874380431908992:12345-0@lo:502:mount.lustre.0 Request processed in 198us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548850.907883:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787548850.907981:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431908992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787548850.909289:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787548850.909369:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787548850.909407:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787548850.909453:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787548850.909483:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787548850.909539:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787548850.909569:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787548850.909595:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787548850.909643:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787548850.909675:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787548850.909701:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787548850.909738:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787548850.909766:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787548850.909791:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787548850.909835:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787548850.909873:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787548850.909904:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787548850.909951:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787548850.909986:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787548850.910013:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787548850.910051:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787548850.910115:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787548850.911336:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787548850.911432:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787548850.911480:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787548850.911515:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787548850.911564:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787548850.911599:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787548850.911631:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787548850.911677:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787548850.911713:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787548850.911747:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787548850.911780:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787548850.911991:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787548850.912034:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787548850.912108:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787548850.912337:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787548850.912393:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787548850.912446:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787548850.912485:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787548850.912533:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431909120:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787548850.912610:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548850.912706:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8602d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787548850.912754:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431909120 00000100:00100000:0.0:1787548850.912762:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431909120 00000100:00100000:0.0:1787548850.912891:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787548850.912976:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15062:x1874380431909120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787548850.913885:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15062:x1874380431909120:12345-0@lo:502:mount.lustre.0 Request processed in 981us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548850.913895:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787548850.914048:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431909120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787548850.914215:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787548850.914303:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787548850.915342:0:15086:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787548850.915358:0:15086:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8fec86113370) 00000020:00000080:2.0:1787548850.915377:0:15086:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787548850.915439:0:15086:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fec88490800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787548850.915443:0:15086:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fec88490800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787548850.915445:0:15086:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fec88490800 3 00010000:00080000:2.0:1787548850.915471:0:15086:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fecad2b9800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.113@tcp at head 00010000:00010000:2.0:1787548850.918087:0:15086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787548850.918888:0:15086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787548850.918945:0:15086:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787548850.918959:0:15086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcb7c48919424f989 00000100:00080000:2.0:1787548850.918968:0:15086:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787548850.918973:0:15086:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8fecad2b9800 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:2.0:1787548850.919007:0:15086:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecb51f1c00 x1874380431909248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787548850.919049:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1874380431909248:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787548850.919128:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548850.919238:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431909248 00000100:00100000:2.0:1787548850.919245:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431909248 00000100:00100000:2.0:1787548850.919283:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787548850.919292:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874380431909248:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787548850.919315:0:14379:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:2.0:1787548850.919348:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcb7c48919424f990 00000004:00100000:2.0:1787548850.919362:0:14379:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787548850.919392:0:14379:0:(import.c:65:import_set_state_nolock()) ffff8fecad2ba800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787548850.919451:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874380431909248:12345-0@lo:38:llog_process_th.0 Request processed in 159us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548850.919459:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787548850.919475:0:15086:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787548850.919496:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787548850.919500:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787548850.919502:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787548850.919505:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1787548850.919869:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fecb51f1c00 x1874380431909248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787548860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548850.919882:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787548850.919892:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787548850.919899:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787548850.919904:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787548850.919906:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fecad2b9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787548850.919912:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1874380431909248:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787548850.920450:0:15086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787548850.920535:0:15062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787548850.920558:0:15062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787548850.920580:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec813f6a00/0xcb7c48919424f974 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f97b expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.920590:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec813f6a00/0xcb7c48919424f974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f97b expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787548850.920641:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787548850.920643:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787548850.920645:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787548850.920646:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787548850.920647:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787548850.920648:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787548850.920650:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787548850.920652:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787548850.920653:0:15062:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787548850.920657:0:15062:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787548850.920659:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787548850.920661:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787548850.920666:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787548850.920667:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787548850.920668:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787548850.920669:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787548850.920670:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787548850.920671:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787548850.920672:0:15062:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787548850.920693:0:15062:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787548850.920709:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431909376:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787548850.920762:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548850.920801:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec881eb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548850.920851:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431909376 00000100:00100000:0.0:1787548850.920858:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431909376 00000100:00100000:0.0:1787548850.920899:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787548850.920908:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15062:x1874380431909376:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787548850.920931:0:14374:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787548850.921546:0:14374:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787548850.948746:0:14374:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787548850.948766:0:14374:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787548850.948909:0:14395:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787548850.948916:0:14395:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787548850.948947:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.948987:0:14395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fec90150400/0xcb7c48919424f904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f8fd expref: 16 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.948995:0:14395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.949042:0:14395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fec90150400/0xcb7c48919424f904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424f8fd expref: 16 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.949059:0:14395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fec90150400/0xcb7c48919424f904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424f8fd expref: 16 pid: 14374 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548850.949087:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14395:1874380431909504:0@lo:104: 00000100:00100000:1.0:1787548850.949185:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548850.949401:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431909504 00000100:00100000:2.0:1787548850.949410:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431909504 00000100:00100000:2.0:1787548850.949464:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787548850.949474:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+3:14395:x1874380431909504:12345-0@lo:104: 00010000:00010000:2.0:1787548850.949487:0:14363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424f904 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548850.949544:0:14363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787548850.949550:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+3:14395:x1874380431909504:12345-0@lo:104: Request processed in 79us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548850.949558:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787548850.950211:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865fbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787548850.950242:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14395:1874380431909504:0@lo:104: 00010000:00010000:1.0:1787548850.950263:0:14395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548850.950416:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548850.950424:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424f904 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548850.950431:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e600 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:0.0:1787548850.950435:0:14367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424f904 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548850.950444:0:14367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424f904 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787548850.950450:0:14367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424f904 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548850.950455:0:14367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787548850.950493:0:14367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f904 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548850.950500:0:14367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787548850.950529:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f904 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548850.950537:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecbd22e600/0xcb7c48919424f8fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f904 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548850.950554:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548850.950556:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548850.950557:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548850.950953:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787548850.950969:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3313:1874380431909632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787548850.951020:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548850.951433:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431909632 00000100:00100000:1.0:1787548850.951440:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431909632 00010000:00010000:1.0:1787548850.951465:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fec90150400/0xcb7c48919424f904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424f8fd expref: 17 pid: 14374 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548850.951502:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787548850.951511:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad561f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:3313:x1874380431909632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787548850.951523:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548850.951528:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fec90150400/0xcb7c48919424f904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424f8fd expref: 17 pid: 14374 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.951544:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fec90150400/0xcb7c48919424f904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424f8fd expref: 17 pid: 14374 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.951558:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec90150400/0xcb7c48919424f904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424f8fd expref: 17 pid: 14374 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.951571:0:14366:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.951578:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787548850.951591:0:14366:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002676649s 00010000:00010000:1.0:1787548850.951596:0:14366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.951603:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.951610:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.951616:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.951621:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e800 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548850.951626:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.951634:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548850.956929:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15062:x1874380431909376:12345-0@lo:253:mount.lustre.0 Request processed in 36013us (36159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548850.956943:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787548850.957064:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15062:1874380431909376:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787548850.957093:0:15062:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787548850.957111:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787548850.957113:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787548850.957114:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787548850.957115:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787548850.957116:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787548850.957117:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787548850.957119:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787548850.957120:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787548850.957121:0:15062:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787548850.957151:0:15062:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787548850.962245:0:14395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548850.962259:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787548850.962514:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787548850.962662:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787548850.962793:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787548850.962945:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787548850.963072:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00010000:00010000:1.0:1787548850.963429:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.963442:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecbd22e800/0xcb7c48919424f997 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548850.963461:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548850.963544:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad561f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+15:3313:x1874380431909632:12345-0@lo:103:ldlm_bl.0 Request processed in 12032us (12522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548850.963553:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787548850.963674:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3313:1874380431909632:0@lo:103:ldlm_bl.0 00080000:10000000:0.0:1787548850.967872:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787548850.968965:0:15062:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787548851.012963:0:15062:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787548851.012971:0:15062:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787548851.013011:0:15062:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787548851.013071:0:15062:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787548851.013098:0:15062:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787548851.013127:0:15062:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787548851.845549:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787548852.813489:0:14377:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787548852.813498:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fecba22b800 from 7 10000000:01000000:0.0:1787548852.813503:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787548852.813548:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548852.813559:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548852.813571:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548852.813594:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431909760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787548852.813659:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548852.813922:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec90108d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787548852.815465:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431909760 00000100:00100000:2.0:1787548852.815478:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431909760 00000100:00100000:2.0:1787548852.823448:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787548852.823469:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+15:14377:x1874380431909760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548852.823487:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548852.823509:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecc21eda00/0xcb7c48919424f9a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424f99e expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548852.823535:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecc21eda00/0xcb7c48919424f9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424f99e expref: 16 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548852.823546:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecc21eda00/0xcb7c48919424f9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f99e expref: 16 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548852.823569:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecc21eda00, rc 0) 00000100:00100000:2.0:1787548852.823649:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:14377:x1874380431909760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (9989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548852.823656:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787548852.823750:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431909760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787548852.823778:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f9a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548852.823787:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424f9a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548852.823850:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431909888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787548852.823886:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548852.823923:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec90108d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787548852.824079:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431909888 00000100:00100000:2.0:1787548852.824086:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431909888 00000100:00100000:2.0:1787548852.824125:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787548852.824167:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:14377:x1874380431909888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787548852.824180:0:14374:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787548852.824196:0:14374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787548852.824199:0:14374:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787548852.824283:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:14377:x1874380431909888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548852.824290:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787548852.824446:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431909888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787548852.824503:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787548852.824510:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f9a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548852.824528:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f9a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548852.883419:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548853.893312:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548854.915600:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548855.939665:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548856.337447:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431910016:0@lo:400:kworker.0 00000100:00100000:2.0:1787548856.337516:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787548856.337584:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787548856.337588:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787548856.337591:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787548856.337594:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787548856.338259:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431910016 00000100:00100000:3.0:1787548856.338269:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431910016 00000100:00100000:3.0:1787548856.338317:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787548856.338327:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:3315:x1874380431910016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548856.342458:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431910144:0@lo:400:kworker.0 00000100:00100000:1.0:1787548856.342533:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548856.342595:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431910144 00000100:00100000:1.0:1787548856.342604:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431910144 00000100:00100000:1.0:1787548856.342682:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787548856.342691:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431910144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548856.342745:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874380431910144:12345-0@lo:400:kworker.0 Request processed in 54us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548856.342752:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787548856.342999:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:3315:x1874380431910016:12345-0@lo:400:kworker.0 Request processed in 4672us (5481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548856.343009:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787548856.346924:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431910016:0@lo:400:kworker.0 00010000:00080000:1.0:1787548856.347410:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fec8833ed80 x1874380431910144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548856.347426:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874380431910144:0@lo:400:kworker.0 00000100:00100000:2.0:1787548856.347516:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431910272:0@lo:400:kworker.0 00000100:00100000:2.0:1787548856.347581:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548856.350405:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431910272 00000100:00100000:3.0:1787548856.350422:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431910272 00000100:00100000:3.0:1787548856.350496:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787548856.350508:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431910272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548856.358482:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431910272:12345-0@lo:400:kworker.0 Request processed in 7967us (10890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548856.358498:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787548856.360967:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787548856.362331:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fec8833ed80 x1874380431910272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548856.362350:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431910272:0@lo:400:kworker.0 00010000:00010000:1.0:1787548856.963389:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548857.987450:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787548858.530317:0:15429:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg613-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1787548858.563855:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787548859.012363:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548860.035818:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548860.163427:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787548845/real 1787548845] req@ffff8fecb51cc000 x1874380431905920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787548860 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548860.163459:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fecb51cc000 x1874380431905920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787548860 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548860.163471:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787548845/real 1787548845] req@ffff8fecb51ce300 x1874380431906048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787548860 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548860.163483:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fecb51ce300 x1874380431906048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787548860 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787548860.163528:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fecad8a3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787548860.163558:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787548860.163562:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431905920:0@lo:8:kworker.0 00000100:00080000:0.0:1787548860.163568:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fec8644e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787548860.163572:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787548860.163575:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431906048:0@lo:8:kworker.0 00000100:00080000:3.0:1787548860.163710:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787548860.163716:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787548860.163718:0:38:0:(import.c:65:import_set_state_nolock()) ffff8fecad8a3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787548860.163723:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:3.0:1787548860.163728:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787548860.163734:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fecad8a3000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:3.0:1787548860.163755:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecad561880 x1874380431910528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787548860.163777:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787548860.163782:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:2.0:1787548860.163782:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1787548860.163792:0:38:0:(import.c:65:import_set_state_nolock()) ffff8fec8644e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787548860.163800:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00100000:2.0:1787548860.163800:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3313:1874380431910400:0@lo:400:kworker.0 00000100:00080000:3.0:1787548860.163804:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787548860.163811:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fec8644e000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:3.0:1787548860.163825:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecad560000 x1874380431910656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787548860.163870:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548860.163882:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874380431910912:0@lo:400:kworker.0 00000100:00100000:2.0:1787548860.163937:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431910784:0@lo:400:kworker.0 00000100:00100000:2.0:1787548860.163975:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431910400 00000100:00100000:2.0:1787548860.163981:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431910400 00000100:00100000:2.0:1787548860.164035:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787548860.164044:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:3313:x1874380431910400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548860.164090:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:3313:x1874380431910400:12345-0@lo:400:kworker.0 Request processed in 47us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548860.164097:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787548860.164162:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3313:1874380431910400:0@lo:400:kworker.0 00000100:00100000:0.0:1787548860.164285:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431910528:0@lo:8:kworker.0 00000100:00100000:0.0:1787548860.164317:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548860.164344:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548860.164358:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431910656:0@lo:8:kworker.0 00000100:00100000:0.0:1787548860.164387:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548860.164492:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431910912 00000100:00100000:2.0:1787548860.164497:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431910912 00000100:00100000:2.0:1787548860.164542:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787548860.164550:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874380431910912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548860.164585:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874380431910912:12345-0@lo:400:kworker.0 Request processed in 36us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548860.164591:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787548860.164598:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548860.164623:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787548860.164638:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecad562680 x1874380431910912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548860.164652:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874380431910912:0@lo:400:kworker.0 00000100:00100000:2.0:1787548860.164656:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431910784 00000100:00100000:2.0:1787548860.164661:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431910784 00000100:00100000:2.0:1787548860.164685:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787548860.164692:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431910784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548860.164744:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431910784:12345-0@lo:400:kworker.0 Request processed in 52us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548860.164751:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787548860.164899:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecad561180 x1874380431910784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548860.164910:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431910784:0@lo:400:kworker.0 00000100:00100000:1.0:1787548860.165050:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431910528 00000100:00100000:1.0:1787548860.165055:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431910528 00000100:00100000:1.0:1787548860.165117:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431910656 00000100:00100000:1.0:1787548860.165120:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431910656 00000100:00100000:1.0:1787548860.165171:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548860.165177:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1874380431910528:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787548860.165198:0:15064:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:1.0:1787548860.165224:0:15064:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb7c48919424f9ac 00002000:00100000:1.0:1787548860.165237:0:15064:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8fec83f4d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787548860.165242:0:15064:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787548860.165244:0:15064:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787548860.169662:0:15064:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787548860.169701:0:15064:0:(import.c:65:import_set_state_nolock()) ffff8fecad2bc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787548860.169786:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874380431910528:12345-0@lo:8:kworker.0 Request processed in 4605us (5465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548860.169801:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787548860.169832:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787548860.169838:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1874380431910656:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787548860.169853:0:15064:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787548860.169875:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1874380431910656:12345-0@lo:8:kworker.0 Request processed in 37us (5488us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787548860.169881:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787548860.170309:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecad561880 x1874380431910528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787548880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787548860.170323:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787548860.170330:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787548860.170338:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787548860.170343:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787548860.170345:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fecad8a3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787548860.170410:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787548860.170416:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431910528:0@lo:8:kworker.0 00000100:00080000:0.0:1787548860.170443:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fec8644e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787548860.170446:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787548860.170449:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431910656:0@lo:8:kworker.0 00000004:00080000:2.0:1787548860.171553:0:14402:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787548860.171577:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14402:1874380431911168:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787548860.171635:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548860.171663:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787548860.171687:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431911168 00000100:00100000:2.0:1787548860.171692:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431911168 00000100:00100000:2.0:1787548860.171740:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787548860.171747:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14402:x1874380431911168:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787548860.171775:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787548860.171788:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431911040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548860.171831:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548860.173070:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431911040 00000100:00100000:0.0:1787548860.173089:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431911040 00000100:00100000:0.0:1787548860.173163:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787548860.173187:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874380431911040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787548860.173218:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548860.173297:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874380431911040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548860.173304:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787548860.173562:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecb51f2d80 x1874380431911040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787548860.173596:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431911040:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1787548860.179065:0:14401:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787548860.179719:0:14401:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 483056586716ns, next at 0ns, rc = 0 00000100:00080000:3.0:1787548860.184697:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1787548860.187620:0:15065:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787548860.187633:0:15065:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787548860.187639:0:15065:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1787548860.206890:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.206908:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e261fd1/0xcb7c48919424f9b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.206938:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.206944:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.206950:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e261fd1/0xcb7c48919424f9b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.206967:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e261fd1/0xcb7c48919424f9b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.206978:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e261fd1/0xcb7c48919424f9b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.206986:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e261fd1/0xcb7c48919424f9b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207004:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787548860.207017:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548860.207035:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e261fd1/0xcb7c48919424f9b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207044:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec600 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548860.207049:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e261fd1/0xcb7c48919424f9b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207056:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e261fd1/0xcb7c48919424f9b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207081:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e261fd1/0xcb7c48919424f9b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207088:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e261fd1/0xcb7c48919424f9b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207108:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548860.207110:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548860.207112:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.207632:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.207640:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003039bcbf/0xcb7c48919424f9ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207649:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.207653:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.207657:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003039bcbf/0xcb7c48919424f9ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207666:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003039bcbf/0xcb7c48919424f9ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207674:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003039bcbf/0xcb7c48919424f9ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207682:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003039bcbf/0xcb7c48919424f9ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207709:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787548860.207718:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548860.207723:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003039bcbf/0xcb7c48919424f9ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207730:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ed400 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548860.207734:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003039bcbf/0xcb7c48919424f9ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207743:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003039bcbf/0xcb7c48919424f9ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207755:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003039bcbf/0xcb7c48919424f9ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207763:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003039bcbf/0xcb7c48919424f9ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.207776:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548860.207778:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548860.207780:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.217561:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.217574:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eaa8236/0xcb7c48919424f9c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.217591:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.217602:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.217609:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eaa8236/0xcb7c48919424f9c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.217624:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eaa8236/0xcb7c48919424f9c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.217635:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eaa8236/0xcb7c48919424f9c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.217643:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eaa8236/0xcb7c48919424f9c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.217662:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787548860.217674:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548860.217680:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eaa8236/0xcb7c48919424f9c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.217687:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ece00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548860.217692:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eaa8236/0xcb7c48919424f9c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.217700:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eaa8236/0xcb7c48919424f9c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.217715:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eaa8236/0xcb7c48919424f9c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.217732:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eaa8236/0xcb7c48919424f9c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.217751:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548860.217753:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548860.217755:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.218276:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.218282:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006243a1ca/0xcb7c48919424f9c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218292:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.218295:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.218299:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006243a1ca/0xcb7c48919424f9c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218309:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006243a1ca/0xcb7c48919424f9c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218316:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006243a1ca/0xcb7c48919424f9c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218323:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006243a1ca/0xcb7c48919424f9c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218337:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787548860.218346:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548860.218355:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006243a1ca/0xcb7c48919424f9c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218363:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec800 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548860.218367:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006243a1ca/0xcb7c48919424f9c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218375:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006243a1ca/0xcb7c48919424f9c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218386:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006243a1ca/0xcb7c48919424f9c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218394:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006243a1ca/0xcb7c48919424f9c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218407:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548860.218409:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548860.218410:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.218792:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.218798:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000127b0537/0xcb7c48919424f9cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218806:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.218809:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.218813:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000127b0537/0xcb7c48919424f9cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218833:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000127b0537/0xcb7c48919424f9cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218842:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000127b0537/0xcb7c48919424f9cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218849:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000127b0537/0xcb7c48919424f9cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218863:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787548860.218871:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548860.218875:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000127b0537/0xcb7c48919424f9cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218882:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ede00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548860.218885:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000127b0537/0xcb7c48919424f9cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218892:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000127b0537/0xcb7c48919424f9cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218903:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000127b0537/0xcb7c48919424f9cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218910:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000127b0537/0xcb7c48919424f9cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.218931:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548860.218933:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548860.218934:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.219368:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.219375:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b3acc2a/0xcb7c48919424f9d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.219384:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.219388:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.219393:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b3acc2a/0xcb7c48919424f9d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.219402:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b3acc2a/0xcb7c48919424f9d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.219410:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b3acc2a/0xcb7c48919424f9d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.219417:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b3acc2a/0xcb7c48919424f9d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.219440:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787548860.219472:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548860.219478:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b3acc2a/0xcb7c48919424f9d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.219486:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21edc00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548860.219490:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b3acc2a/0xcb7c48919424f9d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.219498:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b3acc2a/0xcb7c48919424f9d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.219513:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b3acc2a/0xcb7c48919424f9d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.219521:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b3acc2a/0xcb7c48919424f9d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.219535:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.219536:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.219538:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.223348:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.223363:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ca1e66/0xcb7c48919424f9dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.223392:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.223397:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.223404:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ca1e66/0xcb7c48919424f9dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.223419:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1ca1e66/0xcb7c48919424f9dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.223445:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ca1e66/0xcb7c48919424f9dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.223453:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ca1e66/0xcb7c48919424f9dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.223471:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787548860.223483:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548860.223489:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1ca1e66/0xcb7c48919424f9dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.223496:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec200 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548860.223501:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ca1e66/0xcb7c48919424f9dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.223509:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ca1e66/0xcb7c48919424f9dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.223535:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1ca1e66/0xcb7c48919424f9dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.223543:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1ca1e66/0xcb7c48919424f9dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.223562:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548860.223564:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548860.223566:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.224035:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.224042:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f9e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.224052:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.224056:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.224060:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f9e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.224070:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f9e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.224078:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f9e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.224084:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f9e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.224118:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787548860.224267:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548860.224274:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f9e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.224282:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ec400 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548860.224285:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f9e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.224294:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f9e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.224309:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f9e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.224316:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c38/0xcb7c48919424f9e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.224332:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548860.224333:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548860.224335:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.224521:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.224528:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a20f11d7/0xcb7c48919424f9eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.224536:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.224539:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.224543:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a20f11d7/0xcb7c48919424f9eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.224551:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a20f11d7/0xcb7c48919424f9eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.224558:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a20f11d7/0xcb7c48919424f9eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.224565:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a20f11d7/0xcb7c48919424f9eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.224588:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787548860.225403:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1787548860.225405:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787548860.225410:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a20f11d7/0xcb7c48919424f9eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.225420:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ed200 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548860.225424:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a20f11d7/0xcb7c48919424f9eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.225432:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a20f11d7/0xcb7c48919424f9eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.225446:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a20f11d7/0xcb7c48919424f9eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.225453:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a20f11d7/0xcb7c48919424f9eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.225469:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548860.225471:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548860.225473:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548860.225526:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f7663c5/0xcb7c48919424f9f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.225537:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.225547:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.225552:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f7663c5/0xcb7c48919424f9f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.225563:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f7663c5/0xcb7c48919424f9f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.225571:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f7663c5/0xcb7c48919424f9f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.225894:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f7663c5/0xcb7c48919424f9f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.225919:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787548860.226001:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548860.226006:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f7663c5/0xcb7c48919424f9f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.226014:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecc21ed000 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548860.226017:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7663c5/0xcb7c48919424f9f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.226048:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7663c5/0xcb7c48919424f9f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.226061:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f7663c5/0xcb7c48919424f9f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.226069:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f7663c5/0xcb7c48919424f9f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.226083:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548860.226086:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548860.226088:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.238581:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.238598:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036136834/0xcb7c48919424f9f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.238616:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.238622:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.238627:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036136834/0xcb7c48919424f9f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.238642:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036136834/0xcb7c48919424f9f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.238652:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036136834/0xcb7c48919424f9f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.238666:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036136834/0xcb7c48919424f9f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.238693:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787548860.239114:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548860.239123:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036136834/0xcb7c48919424f9f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.239165:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2b800 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548860.239186:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036136834/0xcb7c48919424f9f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.239196:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036136834/0xcb7c48919424f9f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.239213:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036136834/0xcb7c48919424f9f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.239221:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036136834/0xcb7c48919424f9f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.239236:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.239238:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.239240:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.239253:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.239259:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000812699dd/0xcb7c48919424fa00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.239268:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.239271:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.239275:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000812699dd/0xcb7c48919424fa00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.239285:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000812699dd/0xcb7c48919424fa00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.239293:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000812699dd/0xcb7c48919424fa00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.239300:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000812699dd/0xcb7c48919424fa00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.239323:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787548860.241629:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548860.241643:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000812699dd/0xcb7c48919424fa00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.241655:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2aa00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548860.241659:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000812699dd/0xcb7c48919424fa00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.241670:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000812699dd/0xcb7c48919424fa00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.241688:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000812699dd/0xcb7c48919424fa00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.241705:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000812699dd/0xcb7c48919424fa00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.241727:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.241741:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.241743:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.242925:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.242935:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfa18a1d/0xcb7c48919424fa07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.242954:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.242958:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.242965:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfa18a1d/0xcb7c48919424fa07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.242978:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfa18a1d/0xcb7c48919424fa07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.242988:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfa18a1d/0xcb7c48919424fa07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.242996:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfa18a1d/0xcb7c48919424fa07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.243019:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787548860.243160:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548860.243167:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfa18a1d/0xcb7c48919424fa07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.243187:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2ba00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548860.243191:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfa18a1d/0xcb7c48919424fa07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.243200:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfa18a1d/0xcb7c48919424fa07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.243215:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfa18a1d/0xcb7c48919424fa07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.243235:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfa18a1d/0xcb7c48919424fa07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.243251:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548860.243253:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548860.243255:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.247974:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.247989:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecebcaef/0xcb7c48919424fa0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.248005:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.248009:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.248015:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecebcaef/0xcb7c48919424fa0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.248039:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecebcaef/0xcb7c48919424fa0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.248068:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecebcaef/0xcb7c48919424fa0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.248076:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecebcaef/0xcb7c48919424fa0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.248097:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787548860.248162:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548860.248169:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecebcaef/0xcb7c48919424fa0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.248184:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2be00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548860.248189:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecebcaef/0xcb7c48919424fa0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.248198:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecebcaef/0xcb7c48919424fa0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.248215:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecebcaef/0xcb7c48919424fa0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.248222:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecebcaef/0xcb7c48919424fa0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.248240:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.248242:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.248244:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.249064:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.249072:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ae0d980/0xcb7c48919424fa15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.249083:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.249086:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.249091:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ae0d980/0xcb7c48919424fa15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.249103:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ae0d980/0xcb7c48919424fa15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.249111:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ae0d980/0xcb7c48919424fa15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.249119:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ae0d980/0xcb7c48919424fa15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.249170:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787548860.249179:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548860.249187:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ae0d980/0xcb7c48919424fa15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.249197:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2b200 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548860.249202:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ae0d980/0xcb7c48919424fa15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.249225:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ae0d980/0xcb7c48919424fa15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.249246:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ae0d980/0xcb7c48919424fa15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.249254:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ae0d980/0xcb7c48919424fa15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.249300:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548860.249304:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548860.249307:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.250168:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.250177:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081bd6a8a/0xcb7c48919424fa1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.250189:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.250193:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.250198:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081bd6a8a/0xcb7c48919424fa1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.250211:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081bd6a8a/0xcb7c48919424fa1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.250220:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081bd6a8a/0xcb7c48919424fa1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.250227:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081bd6a8a/0xcb7c48919424fa1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.250244:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787548860.250302:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548860.250309:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081bd6a8a/0xcb7c48919424fa1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.250318:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2b000 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548860.250322:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081bd6a8a/0xcb7c48919424fa1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.250330:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081bd6a8a/0xcb7c48919424fa1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.250343:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081bd6a8a/0xcb7c48919424fa1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.250350:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081bd6a8a/0xcb7c48919424fa1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.250365:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.250367:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.250369:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787548860.252006:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.252017:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fa43b02/0xcb7c48919424fa23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.252041:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.252052:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.252058:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fa43b02/0xcb7c48919424fa23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.252070:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fa43b02/0xcb7c48919424fa23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.252079:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fa43b02/0xcb7c48919424fa23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.252087:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fa43b02/0xcb7c48919424fa23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.252110:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787548860.252168:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548860.252184:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fa43b02/0xcb7c48919424fa23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.252193:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2a400 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548860.252198:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fa43b02/0xcb7c48919424fa23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.252206:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fa43b02/0xcb7c48919424fa23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.252220:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fa43b02/0xcb7c48919424fa23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.252237:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fa43b02/0xcb7c48919424fa23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.252255:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548860.252257:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548860.252259:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787548860.253482:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787548860.253726:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787548860.253734:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a67d339d/0xcb7c48919424fa2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.253748:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787548860.253752:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548860.253756:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a67d339d/0xcb7c48919424fa2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.253769:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a67d339d/0xcb7c48919424fa2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.253778:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a67d339d/0xcb7c48919424fa2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.253793:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a67d339d/0xcb7c48919424fa2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548860.253815:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787548860.253886:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548860.253893:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a67d339d/0xcb7c48919424fa2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.253901:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2bc00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548860.253905:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a67d339d/0xcb7c48919424fa2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.253924:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a67d339d/0xcb7c48919424fa2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.253938:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a67d339d/0xcb7c48919424fa2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.253944:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a67d339d/0xcb7c48919424fa2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.253963:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.253965:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.253967:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787548860.260212:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787548860.260225:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424fa31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.260243:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1787548860.260248:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548860.260255:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424fa31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.260269:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424fa31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.260279:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424fa31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.260287:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424fa31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.260312:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787548860.260948:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787548860.260961:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a17ae08b/0xcb7c48919424fa38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.260972:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1787548860.260975:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548860.260980:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a17ae08b/0xcb7c48919424fa38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.260990:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a17ae08b/0xcb7c48919424fa38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.260999:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a17ae08b/0xcb7c48919424fa38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.261006:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a17ae08b/0xcb7c48919424fa38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.261036:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787548860.262041:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787548860.262051:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424fa3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.262062:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1787548860.262065:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548860.262069:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424fa3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.262080:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424fa3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.262096:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424fa3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.262104:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424fa3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.262113:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787548860.263178:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787548860.263188:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053ba75e3/0xcb7c48919424fa46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.263201:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1787548860.263205:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548860.263209:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053ba75e3/0xcb7c48919424fa46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.263220:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053ba75e3/0xcb7c48919424fa46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.263228:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053ba75e3/0xcb7c48919424fa46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.263237:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053ba75e3/0xcb7c48919424fa46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.263259:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1787548860.263305:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787548860.263313:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424fa31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263322:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92600 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548860.263327:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424fa31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263336:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424fa31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263353:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424fa31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263371:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0e24933/0xcb7c48919424fa31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263390:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787548860.263394:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a17ae08b/0xcb7c48919424fa38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263401:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93000 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548860.263404:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a17ae08b/0xcb7c48919424fa38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263412:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a17ae08b/0xcb7c48919424fa38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263422:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a17ae08b/0xcb7c48919424fa38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263429:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a17ae08b/0xcb7c48919424fa38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263441:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787548860.263444:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424fa3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263451:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93400 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548860.263460:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424fa3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263467:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424fa3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263477:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424fa3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263484:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075d86f73/0xcb7c48919424fa3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263494:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548860.263497:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053ba75e3/0xcb7c48919424fa46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263502:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92000 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548860.263505:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ba75e3/0xcb7c48919424fa46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263512:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ba75e3/0xcb7c48919424fa46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263521:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053ba75e3/0xcb7c48919424fa46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263528:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053ba75e3/0xcb7c48919424fa46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.263545:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.263547:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.263549:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787548860.263670:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787548860.263676:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee960437/0xcb7c48919424fa4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.263684:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1787548860.263687:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548860.263691:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee960437/0xcb7c48919424fa4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.263700:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee960437/0xcb7c48919424fa4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.263709:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee960437/0xcb7c48919424fa4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.263715:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee960437/0xcb7c48919424fa4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.263736:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787548860.264009:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548860.264016:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee960437/0xcb7c48919424fa4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.264035:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93200 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548860.264040:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee960437/0xcb7c48919424fa4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.264048:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee960437/0xcb7c48919424fa4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.264060:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee960437/0xcb7c48919424fa4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.264068:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548860.264070:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548860.264076:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.264690:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548860.271473:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee960437/0xcb7c48919424fa4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787548860.272112:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787548860.272121:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e099976/0xcb7c48919424fa54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.272164:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1787548860.272169:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548860.272176:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e099976/0xcb7c48919424fa54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.272191:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e099976/0xcb7c48919424fa54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.272200:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e099976/0xcb7c48919424fa54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.272208:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e099976/0xcb7c48919424fa54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.272227:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787548860.272616:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787548860.272622:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000594d3b2b/0xcb7c48919424fa5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.272631:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1787548860.272634:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548860.272639:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000594d3b2b/0xcb7c48919424fa5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.272649:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000594d3b2b/0xcb7c48919424fa5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.272669:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000594d3b2b/0xcb7c48919424fa5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.272676:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000594d3b2b/0xcb7c48919424fa5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.272699:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787548860.273096:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787548860.273103:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009341bd65/0xcb7c48919424fa62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.273112:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1787548860.273116:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548860.273120:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009341bd65/0xcb7c48919424fa62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.273157:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009341bd65/0xcb7c48919424fa62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.273166:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009341bd65/0xcb7c48919424fa62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.273173:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009341bd65/0xcb7c48919424fa62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.273194:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787548860.273594:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787548860.273600:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424fa69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.273609:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1787548860.273612:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548860.273617:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424fa69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.273626:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424fa69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.273633:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424fa69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.273640:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424fa69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.273649:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787548860.274058:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787548860.274065:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f35ebfe/0xcb7c48919424fa70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.274074:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1787548860.274085:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548860.274089:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f35ebfe/0xcb7c48919424fa70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.274099:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f35ebfe/0xcb7c48919424fa70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.274107:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f35ebfe/0xcb7c48919424fa70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548860.274114:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f35ebfe/0xcb7c48919424fa70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.275861:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787548860.275873:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e099976/0xcb7c48919424fa54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.275897:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92200 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548860.275902:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e099976/0xcb7c48919424fa54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.275911:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e099976/0xcb7c48919424fa54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.275930:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e099976/0xcb7c48919424fa54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.275939:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e099976/0xcb7c48919424fa54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.275960:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787548860.275963:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000594d3b2b/0xcb7c48919424fa5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.275968:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93800 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548860.275971:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000594d3b2b/0xcb7c48919424fa5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.275978:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000594d3b2b/0xcb7c48919424fa5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.275985:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000594d3b2b/0xcb7c48919424fa5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.275997:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000594d3b2b/0xcb7c48919424fa5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.276009:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787548860.276012:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009341bd65/0xcb7c48919424fa62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.276019:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92e00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548860.276022:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009341bd65/0xcb7c48919424fa62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.276041:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009341bd65/0xcb7c48919424fa62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.276052:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009341bd65/0xcb7c48919424fa62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.276058:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009341bd65/0xcb7c48919424fa62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.276069:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548860.276073:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424fa69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.276078:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92800 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548860.276087:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424fa69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.276094:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424fa69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.276104:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424fa69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.276111:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048bc1411/0xcb7c48919424fa69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548860.276123:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548860.276125:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548860.276126:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.276419:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548860.283626:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787548860.284007:0:15065:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:1.0:1787548860.284107:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548860.284116:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f35ebfe/0xcb7c48919424fa70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548860.284118:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14402:x1874380431911168:12345-0@lo:5:osp-pre-0-0.0 Request processed in 112367us (112478us total) trans 0 rc 0/0 00010000:00010000:1.0:1787548860.284142:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92400 already unused, calling callback (ffffffffc1679230) 00000100:00100000:3.0:1787548860.284146:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787548860.284148:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f35ebfe/0xcb7c48919424fa70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.284158:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f35ebfe/0xcb7c48919424fa70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.284188:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f35ebfe/0xcb7c48919424fa70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.284197:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f35ebfe/0xcb7c48919424fa70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548860.284218:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.284220:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548860.284222:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548860.284348:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14402:1874380431911168:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787548860.284364:0:14402:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787548860.284405:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14402:1874380431911296:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787548860.284440:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548860.284488:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d3a000 going to sleep for 11 seconds 00000100:00100000:3.0:1787548860.288069:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431911296 00000100:00100000:3.0:1787548860.288084:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431911296 00000100:00100000:3.0:1787548860.288215:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787548860.288227:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14402:x1874380431911296:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787548860.288279:0:15064:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1787548860.298282:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14402:x1874380431911296:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10051us (13835us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787548860.298295:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787548860.298482:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14402:1874380431911296:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787548860.298505:0:14402:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1787548861.062750:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787548861.584592:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1787548861.584656:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787548862.083273:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548863.109464:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548864.132518:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548865.155380:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548865.541802:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787548865.541822:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431911424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548865.541885:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548865.541959:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431911424 00000100:00100000:0.0:1787548865.541966:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431911424 00000100:00100000:0.0:1787548865.542047:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787548865.542057:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431911424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787548865.542090:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548865.542166:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431911424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548865.542173:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787548865.542534:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787548865.542566:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787548865.542587:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431911424:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787548865.545700:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787548865.545707:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787548865.545710:0:38:0:(import.c:65:import_set_state_nolock()) ffff8fec8644e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787548865.545718:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:2.0:1787548865.545723:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787548865.545729:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fec8644e000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:2.0:1787548865.545758:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecb51f0700 x1874380431911680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787548865.545812:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431911936:0@lo:400:kworker.0 00000100:00100000:2.0:1787548865.545871:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548865.545932:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431911936 00000100:00100000:2.0:1787548865.545938:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431911936 00000100:00100000:2.0:1787548865.545987:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787548865.546007:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431911936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548865.546066:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431911936:12345-0@lo:400:kworker.0 Request processed in 71us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548865.546073:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787548865.546094:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787548865.546117:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecb51f2d80 x1874380431911936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548865.546152:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431911936:0@lo:400:kworker.0 00000100:00100000:2.0:1787548865.546189:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431911552:0@lo:400:kworker.0 00000100:00100000:2.0:1787548865.546218:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548865.546244:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787548865.546250:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431911808:0@lo:400:kworker.0 00000100:00100000:2.0:1787548865.546270:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548865.547108:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431911808 00000100:00100000:2.0:1787548865.547119:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431911808 00000100:00100000:2.0:1787548865.547589:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787548865.547599:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431911808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548865.547662:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431911808:12345-0@lo:400:kworker.0 Request processed in 64us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548865.547675:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787548865.547717:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecb51f0e00 x1874380431911808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548865.547729:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431911808:0@lo:400:kworker.0 00000100:00100000:2.0:1787548865.547785:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431911552 00000100:00100000:2.0:1787548865.547790:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431911552 00000100:00100000:2.0:1787548865.547815:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787548865.547821:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:3315:x1874380431911552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548865.547857:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:3315:x1874380431911552:12345-0@lo:400:kworker.0 Request processed in 36us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548865.547863:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787548865.547910:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431911552:0@lo:400:kworker.0 00000100:00100000:0.0:1787548865.549171:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431911680:0@lo:8:kworker.0 00000100:00100000:0.0:1787548865.549233:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548865.549713:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431911680 00000100:00100000:1.0:1787548865.549721:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431911680 00000100:00100000:1.0:1787548865.549755:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787548865.549763:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1874380431911680:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787548865.549781:0:15065:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787548865.617071:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1874380431911680:12345-0@lo:8:kworker.0 Request processed in 67301us (67831us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787548865.617090:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787548865.617424:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fec8644e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787548865.617430:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787548865.617435:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431911680:0@lo:8:kworker.0 00010000:00010000:2.0:1787548866.180337:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787548866.858177:0:15780:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787548866.858183:0:15780:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787548866.858314:0:15780:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fecad2ba000 00000020:01000004:2.0:1787548866.858335:0:15780:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787548866.858351:0:15780:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787548866.858369:0:15780:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8fec861119b8) 00000020:00000080:2.0:1787548866.858389:0:15780:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787548866.931485:0:15780:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787548866.931975:0:15780:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787548866.932941:0:15780:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787548866.933340:0:15780:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787548866.933886:0:15780:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787548866.934339:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 477: rc = 0 00100000:10000000:2.0:1787548866.934478:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 477: rc = 0 00100000:10000000:2.0:1787548866.934559:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 477: rc = 0 00100000:10000000:2.0:1787548866.935250:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 310: rc = 0 00100000:10000000:2.0:1787548866.935633:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 310: rc = 0 00100000:10000000:2.0:1787548866.936019:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 310: rc = 0 00100000:10000000:2.0:1787548866.936288:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 310: rc = 0 00100000:10000000:2.0:1787548866.941217:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 310: rc = 0 00100000:10000000:2.0:1787548866.941558:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 310: rc = 0 00000020:00000080:3.0:1787548866.945458:0:15780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787548866.945477:0:15780:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787548866.945493:0:15780:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcb7c48919424fa7e 00000020:01000004:3.0:1787548866.945504:0:15780:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787548866.945530:0:15780:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787548866.945551:0:15780:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787548866.945558:0:15780:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787548866.945589:0:15780:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787548866.945593:0:15780:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787548866.972475:0:15780:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787548866.972535:0:15780:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.113@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787548866.972541:0:15780:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787548866.972543:0:15780:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787548866.972545:0:15780:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787548866.972546:0:15780:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787548866.972548:0:15780:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787548866.972549:0:15780:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787548866.972551:0:15780:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787548866.972553:0:15780:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787548866.972554:0:15780:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787548866.972559:0:15780:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787548866.972561:0:15780:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787548866.972563:0:15780:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787548866.972564:0:15780:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787548866.972565:0:15780:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787548866.972566:0:15780:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787548866.972567:0:15780:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787548866.972569:0:15780:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787548866.972569:0:15780:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787548866.972571:0:15780:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787548866.972605:0:15780:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787548866.972632:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912064:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787548866.972724:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548866.972806:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787548866.973096:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431912064 00000100:00100000:2.0:1787548866.973105:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431912064 00000100:00100000:2.0:1787548866.973185:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787548866.973195:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15780:x1874380431912064:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787548866.973231:0:14374:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787548866.973234:0:14374:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787548866.973238:0:14374:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787548867.000075:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15780:x1874380431912064:12345-0@lo:253:mount.lustre.0 Request processed in 26865us (27335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548867.000094:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787548867.000291:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912064:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787548867.000312:0:15780:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787548867.000317:0:15780:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787548867.000318:0:15780:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787548867.000320:0:15780:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787548867.000322:0:15780:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787548867.000343:0:15780:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787548867.000345:0:15780:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787548867.000347:0:15780:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787548867.000349:0:15780:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787548867.000350:0:15780:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787548867.000376:0:15780:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fecad2ba000 from lustre-OST0001 10000000:01000000:3.0:1787548867.000406:0:15780:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787548867.000410:0:15780:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787548867.000421:0:15780:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8feb811e99b8 local copy 00010000:00010000:3.0:1787548867.000434:0:15780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92c00/0xcb7c48919424f824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f82b expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548867.000746:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787548867.000794:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548867.000922:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1540 going to sleep for 11 seconds 00000100:00100000:2.0:1787548867.001002:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431912192 00000100:00100000:2.0:1787548867.001010:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431912192 00000100:00100000:2.0:1787548867.001066:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787548867.001076:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15780:x1874380431912192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787548867.001421:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15780:x1874380431912192:12345-0@lo:501:mount.lustre.0 Request processed in 346us (626us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787548867.001429:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787548867.001852:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912192:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787548867.001878:0:15780:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787548867.002155:0:15780:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787548867.002167:0:15780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92c00/0xcb7c48919424f824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f82b expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548867.002178:0:15780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92c00/0xcb7c48919424f824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424f82b expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548867.002214:0:15780:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fecad2ba000 10000000:01000000:0.0:1787548867.002221:0:15780:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787548867.002227:0:15780:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787548867.002230:0:15780:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787548867.002236:0:15780:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787548867.002240:0:15780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787548867.002277:0:15780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90150c00/0xcb7c48919424fa85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548867.002286:0:15780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec90150c00/0xcb7c48919424fa85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548867.002299:0:15780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec90150c00/0xcb7c48919424fa85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548867.002334:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912320:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787548867.002383:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548867.002422:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86a9e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548867.002701:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431912320 00000100:00100000:2.0:1787548867.002714:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431912320 00000100:00100000:2.0:1787548867.002774:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787548867.002783:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:15780:x1874380431912320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787548867.002796:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548867.002810:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8feb81e2bc00/0xcb7c48919424fa8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424fa85 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548867.002835:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8feb81e2bc00/0xcb7c48919424fa8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424fa85 expref: 17 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548867.002845:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8feb81e2bc00/0xcb7c48919424fa8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424fa85 expref: 17 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548867.002855:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2bc00, rc 0) 00000100:00100000:2.0:1787548867.002908:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:15780:x1874380431912320:12345-0@lo:101:mount.lustre.0 Request processed in 125us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548867.002914:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787548867.003074:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787548867.003089:0:15780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec90150c00/0xcb7c48919424fa85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fa8c expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548867.003099:0:15780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec90150c00/0xcb7c48919424fa85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424fa8c expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787548867.008259:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787548867.017421:0:15780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787548867.017795:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787548867.017847:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787548867.017914:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787548867.017966:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787548867.018019:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787548867.018066:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787548867.018169:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787548867.018178:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787548867.018306:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787548867.018392:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548867.018454:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca08d1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787548867.018789:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431912448 00000100:00100000:3.0:1787548867.018799:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431912448 00000100:00100000:3.0:1787548867.018870:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787548867.018882:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:15780:x1874380431912448:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787548867.019551:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:15780:x1874380431912448:12345-0@lo:501:mount.lustre.0 Request processed in 666us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548867.019563:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787548867.019894:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787548867.019952:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787548867.020019:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548867.020059:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca08d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787548867.020920:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431912576 00000100:00100000:0.0:1787548867.020931:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431912576 00000100:00100000:0.0:1787548867.021023:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787548867.021038:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:15780:x1874380431912576:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787548867.021651:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:15780:x1874380431912576:12345-0@lo:503:mount.lustre.0 Request processed in 616us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548867.021661:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787548867.023472:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912576:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787548867.026332:0:15780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787548867.026457:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787548867.026574:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548867.026917:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431912704 00000100:00100000:3.0:1787548867.026927:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431912704 00000100:00100000:0.0:1787548867.036391:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86a9e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787548867.038640:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787548867.038668:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:15780:x1874380431912704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787548867.040463:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:15780:x1874380431912704:12345-0@lo:502:mount.lustre.0 Request processed in 1796us (13876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548867.040479:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787548867.045461:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787548867.048545:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787548867.048663:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787548867.048700:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787548867.048749:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787548867.048784:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787548867.048859:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787548867.048908:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787548867.048938:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787548867.048999:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787548867.049067:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787548867.050954:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548867.051035:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86a9e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548867.051221:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431912832 00000100:00100000:1.0:1787548867.051232:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431912832 00000100:00100000:1.0:1787548867.051294:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787548867.051306:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:15780:x1874380431912832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787548867.051626:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:15780:x1874380431912832:12345-0@lo:502:mount.lustre.0 Request processed in 321us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548867.051635:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787548867.051702:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787548867.051969:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787548867.052003:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787548867.057221:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787548867.057237:0:15782:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787548867.057248:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548867.057250:0:15782:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787548867.057257:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787548867.057302:0:15782:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8feb81db8000) 00000020:00000080:3.0:1787548867.057334:0:15782:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787548867.057343:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787548867.057432:0:15782:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fecad2ba000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787548867.057441:0:15782:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787548867.057450:0:15782:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcb7c48919424fa9a 00010000:00010000:0.0:1787548867.066434:0:15782:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1787548867.066940:0:15782:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1787548867.073652:0:15782:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787548867.079903:0:15782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787548867.079918:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787548867.079926:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548867.079928:0:15782:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787548867.079931:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787548867.079935:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548867.079936:0:15782:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787548867.079939:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787548867.079941:0:15782:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787548867.079943:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787548867.079945:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548867.079947:0:15782:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787548867.079949:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787548867.079951:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548867.079953:0:15782:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787548867.079956:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787548867.080044:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787548867.080048:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787548867.080049:0:15782:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787548867.080053:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787548867.091461:0:15780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787548867.091519:0:15780:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787548867.091594:0:15780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90150c00/0xcb7c48919424fa85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fa8c expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.091610:0:15780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec90150c00/0xcb7c48919424fa85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fa8c expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548867.091619:0:15780:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fecad2ba000 from 1 10000000:01000000:3.0:1787548867.091622:0:15780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787548867.091671:0:15780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.091680:0:15780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.091692:0:15780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548867.091723:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787548867.091836:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548867.091884:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787548867.094269:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431912960 00000100:00100000:2.0:1787548867.094289:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431912960 00000100:00100000:2.0:1787548867.094374:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787548867.094386:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:15780:x1874380431912960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787548867.094409:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548867.094431:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8feb81e2b000/0xcb7c48919424faa8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424faa1 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548867.094467:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8feb81e2b000/0xcb7c48919424faa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424faa1 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548867.094498:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8feb81e2b000/0xcb7c48919424faa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424faa1 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548867.094510:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2b000, rc 0) 00000100:00100000:2.0:1787548867.094607:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:15780:x1874380431912960:12345-0@lo:101:mount.lustre.0 Request processed in 223us (2771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548867.094614:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787548867.096498:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431912960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787548867.096535:0:15780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424faa8 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.096549:0:15780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424faa8 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787548867.097893:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787548867.100782:0:15780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787548867.101126:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787548867.105438:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787548867.105648:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787548867.105656:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787548867.105778:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787548867.105867:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548867.105928:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787548867.106949:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431913088 00000100:00100000:0.0:1787548867.106965:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431913088 00000100:00100000:0.0:1787548867.107060:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787548867.107071:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:15780:x1874380431913088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787548867.107442:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:15780:x1874380431913088:12345-0@lo:501:mount.lustre.0 Request processed in 371us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548867.107452:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787548867.109932:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787548867.110037:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787548867.110418:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548867.110479:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787548867.111573:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431913216 00000100:00100000:0.0:1787548867.111587:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431913216 00000100:00100000:0.0:1787548867.111656:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787548867.111668:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:15780:x1874380431913216:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787548867.112093:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:15780:x1874380431913216:12345-0@lo:503:mount.lustre.0 Request processed in 425us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548867.112103:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787548867.112651:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913216:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787548867.115106:0:15780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787548867.116575:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787548867.116692:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548867.116752:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec837f1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787548867.117287:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431913344 00000100:00100000:0.0:1787548867.117297:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431913344 00000100:00100000:0.0:1787548867.117359:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787548867.117370:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:15780:x1874380431913344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787548867.117719:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:15780:x1874380431913344:12345-0@lo:502:mount.lustre.0 Request processed in 349us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548867.117728:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787548867.119524:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787548867.119882:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787548867.119959:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787548867.120028:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787548867.120068:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787548867.120102:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787548867.121660:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787548867.121748:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787548867.121822:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787548867.121887:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787548867.122007:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548867.122061:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca71f9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787548867.122198:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431913472 00000100:00100000:2.0:1787548867.122208:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431913472 00000100:00100000:2.0:1787548867.122266:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787548867.122277:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:15780:x1874380431913472:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787548867.122538:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:15780:x1874380431913472:12345-0@lo:502:mount.lustre.0 Request processed in 262us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548867.122547:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787548867.122872:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787548867.123036:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787548867.123050:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787548867.137480:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787548867.137493:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548867.137496:0:15786:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787548867.137502:0:15786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fecad2ba000 00000020:00000080:3.0:1787548867.137590:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787548867.137600:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787548867.137603:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548867.137604:0:15786:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787548867.137607:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787548867.137609:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548867.137610:0:15786:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787548867.137613:0:15786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fecad2ba000 00000020:00000080:3.0:1787548867.137615:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787548867.137676:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787548867.137680:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548867.137681:0:15786:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787548867.137685:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787548867.137687:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548867.137688:0:15786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787548867.137692:0:15786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fecad2ba000 00000020:00000080:3.0:1787548867.137694:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787548867.137737:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787548867.137741:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787548867.137743:0:15786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787548867.137746:0:15786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787548867.141074:0:15780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787548867.141157:0:15780:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787548867.141190:0:15780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424faa8 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548867.141206:0:15780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424faa8 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787548867.141291:0:15780:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787548867.141295:0:15780:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fecad2ba000 10000000:01000000:0.0:1787548867.141299:0:15780:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fecad2ba000 10000000:01000000:0.0:1787548867.141304:0:15780:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787548867.141311:0:15780:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fecad2ba000 from 1 10000000:01000000:0.0:1787548867.141315:0:15780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787548867.141361:0:15780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90151a00/0xcb7c48919424faaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548867.141370:0:15780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8fec90151a00/0xcb7c48919424faaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548867.141382:0:15780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8fec90151a00/0xcb7c48919424faaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548867.141412:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787548867.141494:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548867.141544:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86a9e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787548867.141574:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431913600 00000100:00100000:0.0:1787548867.141581:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431913600 00000100:00100000:0.0:1787548867.141631:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787548867.141644:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:15780:x1874380431913600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787548867.141659:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548867.141673:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90151400/0xcb7c48919424fab6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424faaf expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548867.141702:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90151400/0xcb7c48919424fab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424faaf expref: 19 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548867.141727:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90151400/0xcb7c48919424fab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424faaf expref: 19 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548867.141738:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151400, rc 0) 00000100:00100000:0.0:1787548867.141783:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:15780:x1874380431913600:12345-0@lo:101:mount.lustre.0 Request processed in 142us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548867.141790:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787548867.141868:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787548867.141886:0:15780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8fec90151a00/0xcb7c48919424faaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fab6 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548867.141897:0:15780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8fec90151a00/0xcb7c48919424faaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424fab6 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787548867.142868:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787548867.143404:0:15780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787548867.149683:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787548867.149810:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787548867.149846:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787548867.149899:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787548867.149937:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787548867.153889:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787548867.154031:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787548867.154075:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787548867.154199:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787548867.154241:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787548867.154279:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787548867.154326:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787548867.154362:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787548867.154390:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787548867.154437:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787548867.154474:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787548867.154510:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787548867.154560:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787548867.154598:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787548867.154652:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787548867.154705:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787548867.154743:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787548867.154776:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787548867.154825:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787548867.154881:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787548867.154918:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787548867.154978:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787548867.155028:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787548867.155063:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787548867.155113:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787548867.155199:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787548867.155238:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787548867.155273:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787548867.155333:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787548867.155383:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787548867.155450:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787548867.155494:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787548867.155634:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787548867.155651:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787548867.155824:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787548867.155913:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548867.156010:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8605a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787548867.158215:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431913728 00000100:00100000:1.0:1787548867.158235:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431913728 00000100:00100000:1.0:1787548867.160016:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787548867.160034:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:15780:x1874380431913728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787548867.160329:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:15780:x1874380431913728:12345-0@lo:501:mount.lustre.0 Request processed in 301us (4417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548867.160337:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787548867.160442:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787548867.160483:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787548867.160521:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548867.160552:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec900cecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548867.160604:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431913856 00000100:00100000:1.0:1787548867.160610:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431913856 00000100:00100000:1.0:1787548867.160639:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787548867.160646:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:15780:x1874380431913856:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787548867.160933:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:15780:x1874380431913856:12345-0@lo:503:mount.lustre.0 Request processed in 286us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548867.160940:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787548867.161078:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913856:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787548867.161598:0:15780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787548867.161662:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787548867.161705:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548867.161726:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec900cecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548867.161807:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431913984 00000100:00100000:1.0:1787548867.161813:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431913984 00000100:00100000:1.0:1787548867.161840:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787548867.161848:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:15780:x1874380431913984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787548867.162094:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:15780:x1874380431913984:12345-0@lo:502:mount.lustre.0 Request processed in 245us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548867.162102:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787548867.162510:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431913984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787548867.162801:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787548867.162864:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787548867.162952:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787548867.163046:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787548867.163093:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787548867.163244:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787548867.163284:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787548867.163328:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787548867.163384:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787548867.163422:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787548867.163482:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787548867.163601:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787548867.163682:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787548867.163725:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787548867.163798:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787548867.163891:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787548867.164012:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787548867.164121:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787548867.164198:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787548867.164234:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787548867.164282:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787548867.164315:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787548867.164343:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787548867.164384:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787548867.164418:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787548867.164450:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787548867.164491:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787548867.164519:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787548867.164546:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787548867.164584:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787548867.164618:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787548867.164670:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787548867.164704:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787548867.164749:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787548867.164783:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787548867.164826:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787548867.164881:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787548867.164916:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787548867.164962:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787548867.165073:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787548867.165118:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431914112:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787548867.165218:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548867.165333:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec900cecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548867.165379:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431914112 00000100:00100000:1.0:1787548867.165386:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431914112 00000100:00100000:1.0:1787548867.165443:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787548867.165451:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:15780:x1874380431914112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787548867.165734:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:15780:x1874380431914112:12345-0@lo:502:mount.lustre.0 Request processed in 283us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548867.165742:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787548867.165838:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431914112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787548867.165924:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787548867.165941:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787548867.167013:0:15791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787548867.167030:0:15791:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8feb81dbb370) 00000020:00000080:3.0:1787548867.167051:0:15791:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787548867.167123:0:15791:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fecad2ba000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787548867.167126:0:15791:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fecad2ba000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787548867.167149:0:15791:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fecad2ba000 3 00010000:00080000:3.0:1787548867.167177:0:15791:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fecad2bb000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.113@tcp at head 00010000:00010000:3.0:1787548867.168767:0:15791:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787548867.169062:0:15791:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787548867.169098:0:15791:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787548867.169111:0:15791:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcb7c48919424fac4 00000100:00080000:3.0:1787548867.169121:0:15791:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787548867.169127:0:15791:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8fecad2bb000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:3.0:1787548867.169188:0:15791:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecad561500 x1874380431914240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787548867.169229:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1874380431914240:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787548867.169294:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548867.169352:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431914240 00000100:00100000:3.0:1787548867.169359:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431914240 00000100:00100000:3.0:1787548867.169390:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787548867.169398:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874380431914240:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787548867.169419:0:14379:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:3.0:1787548867.169449:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcb7c48919424facb 00000004:00100000:3.0:1787548867.169463:0:14379:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787548867.169490:0:14379:0:(import.c:65:import_set_state_nolock()) ffff8fecb3412800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787548867.169535:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874380431914240:12345-0@lo:38:llog_process_th.0 Request processed in 136us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548867.169542:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787548867.169578:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecad561500 x1874380431914240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787548877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548867.169587:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787548867.169594:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787548867.169600:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787548867.169603:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787548867.169605:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fecad2bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787548867.169611:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1874380431914240:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787548867.169630:0:15791:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787548867.169670:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787548867.169675:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787548867.169683:0:38:0:(import.c:65:import_set_state_nolock()) ffff8fec8644e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787548867.169687:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:3.0:1787548867.169690:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787548867.169694:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fec8644e000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:3.0:1787548867.169709:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecad561180 x1874380431914496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787548867.169763:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431914368:0@lo:400:kworker.0 00000100:00100000:3.0:1787548867.170741:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548867.170848:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431914624:0@lo:400:kworker.0 00000100:00100000:3.0:1787548867.170885:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548867.170914:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787548867.170932:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431914752:0@lo:400:kworker.0 00000100:00100000:3.0:1787548867.170956:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548867.170982:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431914496:0@lo:8:kworker.0 00000100:00100000:3.0:1787548867.171019:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548867.171078:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431914624 00000100:00100000:0.0:1787548867.171094:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431914624 00000100:00100000:3.0:1787548867.171314:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431914752 00000100:00100000:3.0:1787548867.171321:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431914752 00000100:00100000:1.0:1787548867.171350:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431914368 00000100:00100000:1.0:1787548867.171354:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431914368 00000100:00100000:1.0:1787548867.171390:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431914496 00000100:00100000:1.0:1787548867.171393:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431914496 00000100:00100000:3.0:1787548867.171398:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787548867.171404:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787548867.171406:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431914752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548867.171409:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431914368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548867.171448:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431914752:12345-0@lo:400:kworker.0 Request processed in 43us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548867.171455:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787548867.171455:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431914368:12345-0@lo:400:kworker.0 Request processed in 46us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548867.171461:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548867.171472:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787548867.171473:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787548867.171476:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787548867.171476:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3312:x1874380431914496:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787548867.171500:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431914368:0@lo:400:kworker.0 00000100:00100000:1.0:1787548867.171512:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3312:x1874380431914496:12345-0@lo:8:kworker.0 Request processed in 35us (492us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787548867.171517:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787548867.171525:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecad561880 x1874380431914752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548867.171541:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431914752:0@lo:400:kworker.0 00000100:00100000:3.0:1787548867.171560:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787548867.171564:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fec8644e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787548867.171568:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787548867.171570:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431914496:0@lo:8:kworker.0 00000040:00080000:3.0:1787548867.172769:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787548867.173219:0:15780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787548867.173247:0:15780:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787548867.173268:0:15780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8fec90151a00/0xcb7c48919424faaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fab6 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548867.173280:0:15780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8fec90151a00/0xcb7c48919424faaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fab6 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787548867.173331:0:15780:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787548867.173338:0:15780:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787548867.173339:0:15780:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787548867.173340:0:15780:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787548867.173341:0:15780:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787548867.173342:0:15780:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787548867.173344:0:15780:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787548867.173345:0:15780:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787548867.173346:0:15780:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787548867.173350:0:15780:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787548867.173352:0:15780:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787548867.173353:0:15780:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787548867.173354:0:15780:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787548867.173355:0:15780:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787548867.173356:0:15780:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787548867.173357:0:15780:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787548867.173358:0:15780:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787548867.173359:0:15780:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787548867.173360:0:15780:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787548867.173382:0:15780:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787548867.173401:0:15780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431914880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787548867.173460:0:15780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548867.173499:0:15780:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec8602d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787548867.175342:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787548867.175359:0:14379:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787548867.175375:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431914624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548867.175385:0:14379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787548867.175516:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431914624:12345-0@lo:400:kworker.0 Request processed in 157us (4628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548867.175539:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787548867.175579:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431914880 00000100:00100000:0.0:1787548867.175589:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431914880 00000100:00100000:0.0:1787548867.175727:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787548867.175736:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:15780:x1874380431914880:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787548867.175767:0:14374:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787548867.175786:0:14374:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1787548867.176522:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fecad560000 x1874380431914624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787548867.176543:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431914624:0@lo:400:kworker.0 00010000:00010000:0.0:1787548867.206882:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1787548867.230678:0:14374:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787548867.230691:0:14374:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787548867.231117:0:14395:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787548867.231122:0:14395:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787548867.231167:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548867.231186:0:14395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fecc21eda00/0xcb7c48919424f9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f99e expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548867.231194:0:14395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548867.231246:0:14395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fecc21eda00/0xcb7c48919424f9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424f99e expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548867.231260:0:14395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fecc21eda00/0xcb7c48919424f9a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424f99e expref: 19 pid: 14373 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548867.231275:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14395:1874380431915008:0@lo:104: 00000100:00100000:2.0:1787548867.231341:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548867.231391:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca08d1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787548867.231510:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431915008 00000100:00100000:3.0:1787548867.231518:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431915008 00000100:00100000:3.0:1787548867.231560:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787548867.231570:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+3:14395:x1874380431915008:12345-0@lo:104: 00010000:00010000:3.0:1787548867.231582:0:14362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424f9a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.231634:0:14362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787548867.231639:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+3:14395:x1874380431915008:12345-0@lo:104: Request processed in 72us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548867.231646:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787548867.231670:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548867.231676:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424f9a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.231689:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150200 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:3.0:1787548867.231693:0:14367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424f9a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.231700:0:14367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424f9a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787548867.231707:0:14367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424f9a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787548867.231712:0:14367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787548867.231739:0:14367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f9a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.231745:0:14367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787548867.231760:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f9a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.231767:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fec90150200/0xcb7c48919424f99e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f9a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.231783:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548867.231785:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548867.231787:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548867.231803:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3313:1874380431915136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787548867.231829:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548867.231867:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431915136 00000100:00100000:3.0:1787548867.231870:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431915136 00010000:00010000:3.0:1787548867.231885:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fecc21eda00/0xcb7c48919424f9a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424f99e expref: 20 pid: 14373 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548867.231910:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787548867.231916:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+20:3313:x1874380431915136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787548867.232187:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548867.232194:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fecc21eda00/0xcb7c48919424f9a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424f99e expref: 20 pid: 14373 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.232204:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fecc21eda00/0xcb7c48919424f9a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424f99e expref: 20 pid: 14373 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.232220:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.232227:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787548867.232239:0:14364:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002676649s 00010000:00010000:3.0:1787548867.232244:0:14364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.232250:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.232256:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.232263:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.232269:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2be00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548867.232279:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.232287:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.232296:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.232306:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548867.232337:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+20:3313:x1874380431915136:12345-0@lo:103:ldlm_bl.0 Request processed in 421us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548867.232343:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787548867.232379:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3313:1874380431915136:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787548867.232416:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecc21eda00/0xcb7c48919424f9a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424f99e expref: 19 pid: 14373 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548867.232427:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14395:1874380431915008:0@lo:104: 00010000:00010000:3.0:1787548867.232440:0:14395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.232449:0:14395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.232455:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548867.232460:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8feb81e2be00/0xcb7c48919424fad2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548867.237389:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:15780:x1874380431914880:12345-0@lo:253:mount.lustre.0 Request processed in 61643us (63917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548867.237403:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787548867.237656:0:15780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:15780:1874380431914880:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787548867.237672:0:15780:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787548867.237675:0:15780:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787548867.237677:0:15780:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787548867.237678:0:15780:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787548867.237679:0:15780:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787548867.237681:0:15780:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787548867.237682:0:15780:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787548867.237684:0:15780:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787548867.237685:0:15780:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787548867.237687:0:15780:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787548867.237701:0:15780:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787548867.242637:0:15780:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548867.242796:0:15780:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787548867.243509:0:15780:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548867.243676:0:15780:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787548867.243820:0:15780:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787548867.244103:0:15780:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787548867.244848:0:15780:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787548867.283697:0:15780:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787548867.283706:0:15780:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787548867.283733:0:15780:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787548867.283783:0:15780:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787548867.283794:0:15780:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787548867.283818:0:15780:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787548868.227298:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787548868.805807:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1787548869.192189:0:14377:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787548869.192196:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fecba22b800 from 8 10000000:01000000:2.0:1787548869.192201:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787548869.192243:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8feb81e2b800/0xcb7c48919424fad9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548869.192256:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8feb81e2b800/0xcb7c48919424fad9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548869.192268:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8feb81e2b800/0xcb7c48919424fad9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548869.194163:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431915264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787548869.194243:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548869.194292:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86a9e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787548869.194318:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431915264 00000100:00100000:2.0:1787548869.194324:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431915264 00000100:00100000:2.0:1787548869.194371:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787548869.194381:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:14377:x1874380431915264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548869.194403:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548869.194419:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8feb81e2aa00/0xcb7c48919424fae0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424fad9 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548869.194556:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8feb81e2aa00/0xcb7c48919424fae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424fad9 expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548869.194567:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8feb81e2aa00/0xcb7c48919424fae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424fad9 expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548869.194575:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2aa00, rc 0) 00000100:00100000:2.0:1787548869.194611:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:14377:x1874380431915264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548869.194618:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787548869.194659:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431915264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548869.194673:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8feb81e2b800/0xcb7c48919424fad9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fae0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548869.194682:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8feb81e2b800/0xcb7c48919424fad9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424fae0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548869.194729:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431915392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787548869.194754:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548869.194773:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431915392 00000100:00100000:2.0:1787548869.194777:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431915392 00000100:00100000:2.0:1787548869.194794:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787548869.194799:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:14377:x1874380431915392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787548869.194818:0:14374:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787548869.194830:0:14374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787548869.194833:0:14374:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787548869.195214:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:14377:x1874380431915392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 413us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548869.195220:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787548869.195239:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86a9e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787548869.195249:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431915392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787548869.195293:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787548869.195299:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8feb81e2b800/0xcb7c48919424fad9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fae0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548869.195306:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8feb81e2b800/0xcb7c48919424fad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fae0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548869.251351:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548870.276554:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548870.663305:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787548870.663327:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431915520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787548870.663390:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548870.663565:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431915520 00000100:00100000:1.0:1787548870.663573:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431915520 00000100:00100000:1.0:1787548870.663633:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787548870.663642:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431915520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787548870.663674:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548870.663720:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431915520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548870.663727:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787548870.663779:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787548870.663813:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431915520:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787548871.303152:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787548872.200810:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787548872.200819:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787548872.200823:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fec8644e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787548872.200837:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fec8644e000 using connection 192.168.206.113@tcp/0@lo 00000100:00100000:2.0:1787548872.200863:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fecb51f0a80 x1874380431915904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787548872.201454:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431915648:0@lo:400:kworker.0 00000100:00100000:2.0:1787548872.201552:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548872.201614:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431916288:0@lo:400:kworker.0 00000100:00100000:2.0:1787548872.201647:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548872.201688:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787548872.201762:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431915776:0@lo:400:kworker.0 00000100:00100000:3.0:1787548872.201769:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431916032:0@lo:400:kworker.0 00000100:00100000:2.0:1787548872.201811:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548872.201819:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548872.201847:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787548872.201854:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431916160:0@lo:400:kworker.0 00000100:00100000:2.0:1787548872.201902:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431915648 00000100:00100000:2.0:1787548872.201911:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431915648 00000100:00100000:2.0:1787548872.201975:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787548872.201989:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:3315:x1874380431915648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548872.202013:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548872.202054:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431915904:0@lo:8:kworker.0 00000100:00100000:2.0:1787548872.202061:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:3315:x1874380431915648:12345-0@lo:400:kworker.0 Request processed in 73us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548872.202071:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787548872.202109:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431916288 00000100:00100000:2.0:1787548872.202119:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431916288 00000100:00100000:3.0:1787548872.202294:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548872.202363:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431916032 00000100:00100000:2.0:1787548872.202368:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431916032 00000100:00100000:2.0:1787548872.202385:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431916160 00000100:00100000:2.0:1787548872.202387:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431916160 00000100:00100000:2.0:1787548872.202406:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787548872.202416:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431916288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548872.202455:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431916288:12345-0@lo:400:kworker.0 Request processed in 41us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548872.202461:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787548872.202485:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787548872.202493:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431916032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548872.202538:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431916032:12345-0@lo:400:kworker.0 Request processed in 47us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548872.202545:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787548872.202567:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787548872.203811:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431916160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548872.203899:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431916160:12345-0@lo:400:kworker.0 Request processed in 1325us (2014us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548872.203909:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787548872.203997:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431915648:0@lo:400:kworker.0 00010000:00080000:2.0:1787548872.204015:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb51f1880 x1874380431916288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548872.204029:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431916288:0@lo:400:kworker.0 00000100:00080000:2.0:1787548872.204067:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787548872.204089:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb51f3100 x1874380431916160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548872.204099:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431916160:0@lo:400:kworker.0 00010000:00080000:2.0:1787548872.204111:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb51f2300 x1874380431916032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548872.204119:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431916032:0@lo:400:kworker.0 00000100:00100000:2.0:1787548872.207075:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431915776 00000100:00100000:2.0:1787548872.207105:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431915776 00000100:00100000:2.0:1787548872.207196:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431915904 00000100:00100000:2.0:1787548872.207200:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431915904 00000100:00100000:2.0:1787548872.207219:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787548872.207231:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431915776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548872.207335:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431915776:12345-0@lo:400:kworker.0 Request processed in 107us (5524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548872.207343:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787548872.207365:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787548872.207384:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1874380431915904:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787548872.207413:0:15064:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:2.0:1787548872.207451:0:15064:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb7c48919424fae7 00002000:00100000:2.0:1787548872.207470:0:15064:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8fecacdea000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787548872.207490:0:15064:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787548872.207493:0:15064:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787548872.207991:0:15064:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787548872.208022:0:15064:0:(import.c:65:import_set_state_nolock()) ffff8fecacded000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787548872.208087:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874380431915904:12345-0@lo:8:kworker.0 Request processed in 701us (5875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548872.208095:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787548872.208285:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431915776:0@lo:400:kworker.0 00010000:00080000:2.0:1787548872.208334:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb51f0a80 x1874380431915904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787548897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787548872.208350:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787548872.208359:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787548872.208366:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787548872.208368:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8fec8644e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787548872.208387:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787548872.208393:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874380431915904:0@lo:8:kworker.0 00000004:00080000:2.0:1787548872.208446:0:14404:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1787548872.208470:0:14404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14404:1874380431916544:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787548872.208513:0:14404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548872.208536:0:14404:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec88381c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787548872.208550:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431916416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787548872.208590:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548872.208635:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431916416 00000100:00100000:2.0:1787548872.208640:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431916416 00000100:00100000:2.0:1787548872.208688:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787548872.211291:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431916544 00000100:00080000:3.0:1787548872.211312:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787548872.211312:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431916544 00000100:00080000:3.0:1787548872.211322:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787548872.211390:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787548872.211399:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787548872.211407:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14404:x1874380431916544:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787548872.211414:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787548872.212933:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874380431916416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787548872.212999:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548872.213146:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874380431916416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4432us (4537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548872.213158:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787548872.213243:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fecb51f0a80 x1874380431916416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787548888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548872.213274:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431916416:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1787548872.215103:0:15065:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787548872.215203:0:15065:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787548872.215211:0:15065:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000004:00080000:1.0:1787548872.216102:0:14403:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787548872.216644:0:14403:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 495093512550ns, next at 0ns, rc = 0 00002000:00010000:0.0:1787548872.229097:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787548872.229124:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021d1d1ac/0xcb7c48919424faee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548872.230372:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1787548872.230379:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787548872.230387:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021d1d1ac/0xcb7c48919424faee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548872.230555:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021d1d1ac/0xcb7c48919424faee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548872.230571:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021d1d1ac/0xcb7c48919424faee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548872.230580:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021d1d1ac/0xcb7c48919424faee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548872.230658:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787548872.230676:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787548872.230683:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021d1d1ac/0xcb7c48919424faee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548872.230692:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150000 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548872.230697:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021d1d1ac/0xcb7c48919424faee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548872.230708:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021d1d1ac/0xcb7c48919424faee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548872.230729:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021d1d1ac/0xcb7c48919424faee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548872.230737:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021d1d1ac/0xcb7c48919424faee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548872.230768:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548872.230770:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548872.230773:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787548872.233467:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.233490:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424faf5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.233513:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.233519:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.233526:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424faf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.233544:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424faf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.233556:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424faf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.233565:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424faf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.233587:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787548872.238697:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.238713:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fafc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.238734:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.238739:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.238746:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fafc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.238762:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fafc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.238782:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fafc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.238790:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fafc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.238839:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787548872.238861:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787548872.238868:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424faf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.238876:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f400 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548872.238881:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424faf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.238892:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424faf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.238914:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424faf5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.238923:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424faf5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.238945:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548872.238957:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fafc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.238974:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e200 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548872.238977:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fafc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.238986:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fafc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.238996:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fafc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.239003:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fafc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.239016:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.239018:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.239020:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787548872.239515:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.239522:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.239532:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.239537:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.239541:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.239563:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.239571:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.239578:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.239594:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787548872.239605:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548872.239609:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.239616:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fc00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548872.239619:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.239628:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.239642:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.239649:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.239671:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.239673:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.239675:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548872.240693:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787548872.248063:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.248083:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.248104:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.248110:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.248118:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.248151:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.248163:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.248171:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.248200:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787548872.248220:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548872.248227:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.248250:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f800 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548872.248256:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.248266:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.248289:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.248298:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.248324:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.248326:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.248329:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787548872.248973:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.248982:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.248994:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.248998:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.249003:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249013:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249028:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249035:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249058:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787548872.249070:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548872.249075:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249083:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f000 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548872.249086:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249094:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249108:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249115:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249166:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.249174:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.249176:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787548872.249630:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.249637:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249647:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.249650:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.249655:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249665:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249673:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249681:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249697:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787548872.249708:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548872.249712:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249720:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fe00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548872.249723:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249742:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249753:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb18 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249760:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.249776:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.249778:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.249780:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787548872.268613:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.268635:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.268657:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.268663:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.268670:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.268687:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.269109:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.269232:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.269262:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787548872.269285:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548872.269292:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.269300:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f000 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548872.269306:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.269317:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.269340:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.269348:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d6f0374/0xcb7c48919424fb1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.269370:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.269372:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.269374:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787548872.282486:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.282511:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.282533:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.282539:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.283651:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.283678:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.283691:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.283793:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.283829:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787548872.284017:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548872.284027:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.284037:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fe00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548872.284042:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.284053:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.284079:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.284087:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094044bb2/0xcb7c48919424fb26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.284151:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.284153:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.284155:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787548872.285200:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.285212:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.285228:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.285232:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.285238:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.285251:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.285271:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.285279:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.285296:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787548872.285321:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548872.285331:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.285341:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f800 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548872.285346:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.285356:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.285379:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.285400:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061126699/0xcb7c48919424fb2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.285425:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548872.285427:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548872.285443:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787548872.286895:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.286919:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.286939:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.286944:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.286950:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.286977:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.286989:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.286998:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.287033:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787548872.287710:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.287718:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fb3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.287729:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.287733:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.287738:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fb3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.287749:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fb3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.287759:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fb3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.287767:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fb3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.287791:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787548872.287808:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787548872.287815:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.287823:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fc00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548872.287835:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.287845:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.287866:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.287875:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f362cd3f/0xcb7c48919424fb34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.287896:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548872.287900:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fb3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.288047:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e200 already unused, calling callback (ffffffffc1679230) 00010000:00010000:1.0:1787548872.288051:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fb3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.288059:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fb3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.288070:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fb3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.288076:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e8a0f36/0xcb7c48919424fb3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.288100:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.288102:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.288104:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787548872.289011:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.289024:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424fb42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.289039:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.289044:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.289049:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424fb42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.289062:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424fb42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.289072:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424fb42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.289080:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424fb42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.289112:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787548872.289181:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548872.289190:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424fb42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.289200:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22f400 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548872.289205:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424fb42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.289215:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424fb42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.289234:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424fb42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.289242:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a563900/0xcb7c48919424fb42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.289261:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548872.289263:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548872.289265:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787548872.290122:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.290152:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424fb49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.290177:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.290181:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.290186:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424fb49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.290199:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424fb49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.290208:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424fb49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.290216:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424fb49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.290232:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787548872.290274:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548872.290282:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424fb49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.290293:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e800 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548872.290298:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424fb49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.290309:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424fb49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.290324:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424fb49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.290331:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac8af781/0xcb7c48919424fb49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548872.290346:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548872.290348:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548872.290350:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.291169:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787548872.291826:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.291837:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078fbe39c/0xcb7c48919424fb50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.291853:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.291859:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.291865:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078fbe39c/0xcb7c48919424fb50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.291880:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078fbe39c/0xcb7c48919424fb50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.291903:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078fbe39c/0xcb7c48919424fb50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.292049:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078fbe39c/0xcb7c48919424fb50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.292108:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787548872.292616:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.292623:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3253b16/0xcb7c48919424fb57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.292633:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.292636:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.292641:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3253b16/0xcb7c48919424fb57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.292651:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3253b16/0xcb7c48919424fb57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.292659:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3253b16/0xcb7c48919424fb57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.292666:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3253b16/0xcb7c48919424fb57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.292809:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787548872.292819:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078fbe39c/0xcb7c48919424fb50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.292829:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22e600 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548872.292834:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078fbe39c/0xcb7c48919424fb50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.292844:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078fbe39c/0xcb7c48919424fb50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.292864:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078fbe39c/0xcb7c48919424fb50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.292872:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078fbe39c/0xcb7c48919424fb50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.292892:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548872.292896:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3253b16/0xcb7c48919424fb57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.292902:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22ee00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548872.292925:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3253b16/0xcb7c48919424fb57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.292934:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3253b16/0xcb7c48919424fb57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.292945:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3253b16/0xcb7c48919424fb57 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.292952:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.292954:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.292956:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.293149:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787548872.293156:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3253b16/0xcb7c48919424fb57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787548872.293709:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.293717:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae3b093e/0xcb7c48919424fb5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.293729:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.293734:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.293739:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae3b093e/0xcb7c48919424fb5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.293752:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae3b093e/0xcb7c48919424fb5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.293761:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae3b093e/0xcb7c48919424fb5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.293769:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae3b093e/0xcb7c48919424fb5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.293817:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548872.293824:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae3b093e/0xcb7c48919424fb5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.293832:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22fa00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548872.293836:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae3b093e/0xcb7c48919424fb5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.293845:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae3b093e/0xcb7c48919424fb5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.293859:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae3b093e/0xcb7c48919424fb5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.294170:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.294177:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.294180:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.294379:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787548872.294387:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae3b093e/0xcb7c48919424fb5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787548872.295001:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.295009:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424fb65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.295022:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.295026:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.295031:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424fb65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.295043:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424fb65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.295052:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424fb65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.295060:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424fb65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.295242:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548872.295249:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424fb65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.295259:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22ea00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548872.295264:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424fb65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.295274:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424fb65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.295293:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424fb65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.295311:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.295313:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.295315:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.295397:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787548872.295402:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008d39ab2/0xcb7c48919424fb65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.295601:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787548872.296253:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.296262:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004788f3f2/0xcb7c48919424fb6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.296288:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.296292:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.296298:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004788f3f2/0xcb7c48919424fb6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.296309:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004788f3f2/0xcb7c48919424fb6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.296491:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004788f3f2/0xcb7c48919424fb6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.296501:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004788f3f2/0xcb7c48919424fb6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.296644:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787548872.297161:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.297168:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7e66e74/0xcb7c48919424fb73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.297180:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.297184:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.297189:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e66e74/0xcb7c48919424fb73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.297201:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7e66e74/0xcb7c48919424fb73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.297220:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7e66e74/0xcb7c48919424fb73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.297229:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e66e74/0xcb7c48919424fb73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.297404:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787548872.297412:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004788f3f2/0xcb7c48919424fb6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.297421:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82134600 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548872.297427:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004788f3f2/0xcb7c48919424fb6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.297450:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004788f3f2/0xcb7c48919424fb6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.297470:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004788f3f2/0xcb7c48919424fb6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.297477:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004788f3f2/0xcb7c48919424fb6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.297497:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548872.297501:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7e66e74/0xcb7c48919424fb73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.297508:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82135400 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548872.297511:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7e66e74/0xcb7c48919424fb73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.297519:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7e66e74/0xcb7c48919424fb73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.297527:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7e66e74/0xcb7c48919424fb73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.297534:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.297536:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.297557:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.297720:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787548872.297726:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7e66e74/0xcb7c48919424fb73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787548872.298302:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.298310:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084982280/0xcb7c48919424fb7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.298323:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.298327:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.298332:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084982280/0xcb7c48919424fb7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.298344:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084982280/0xcb7c48919424fb7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.298353:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084982280/0xcb7c48919424fb7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.298372:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084982280/0xcb7c48919424fb7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.298416:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548872.298423:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084982280/0xcb7c48919424fb7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.298431:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82134800 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548872.298435:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084982280/0xcb7c48919424fb7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.298445:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084982280/0xcb7c48919424fb7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.298459:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084982280/0xcb7c48919424fb7a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.298468:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.298469:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.298471:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.298535:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787548872.298540:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084982280/0xcb7c48919424fb7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787548872.299115:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.299122:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093d274a3/0xcb7c48919424fb81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.299159:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.299163:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.299168:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093d274a3/0xcb7c48919424fb81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.299179:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093d274a3/0xcb7c48919424fb81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.299188:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093d274a3/0xcb7c48919424fb81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.299196:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093d274a3/0xcb7c48919424fb81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.299305:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548872.299311:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093d274a3/0xcb7c48919424fb81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.299319:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82134e00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548872.299323:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093d274a3/0xcb7c48919424fb81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.299331:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093d274a3/0xcb7c48919424fb81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.299357:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093d274a3/0xcb7c48919424fb81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.299365:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.299367:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.299370:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.300154:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787548872.300164:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093d274a3/0xcb7c48919424fb81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787548872.300779:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.300787:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b298a6d7/0xcb7c48919424fb88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.300801:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.300804:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.300809:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b298a6d7/0xcb7c48919424fb88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.300823:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b298a6d7/0xcb7c48919424fb88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.300832:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b298a6d7/0xcb7c48919424fb88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.300840:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b298a6d7/0xcb7c48919424fb88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.301858:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548872.301872:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b298a6d7/0xcb7c48919424fb88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.301884:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82134200 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548872.301890:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b298a6d7/0xcb7c48919424fb88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.301902:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b298a6d7/0xcb7c48919424fb88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.301989:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b298a6d7/0xcb7c48919424fb88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.302066:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.302068:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.302070:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.302222:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787548872.302229:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b298a6d7/0xcb7c48919424fb88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787548872.302880:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.302887:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a616fc8e/0xcb7c48919424fb8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.302900:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.302905:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.303069:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a616fc8e/0xcb7c48919424fb8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.303084:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a616fc8e/0xcb7c48919424fb8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.303094:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a616fc8e/0xcb7c48919424fb8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.303102:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a616fc8e/0xcb7c48919424fb8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.303251:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548872.303260:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a616fc8e/0xcb7c48919424fb8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.303282:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82134c00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548872.303287:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a616fc8e/0xcb7c48919424fb8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.303296:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a616fc8e/0xcb7c48919424fb8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.303314:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a616fc8e/0xcb7c48919424fb8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.303323:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.303324:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.303326:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.303412:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787548872.303418:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a616fc8e/0xcb7c48919424fb8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787548872.304512:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.304523:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a67584ae/0xcb7c48919424fb96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.304561:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.304565:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.304571:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a67584ae/0xcb7c48919424fb96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.304584:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a67584ae/0xcb7c48919424fb96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.304594:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a67584ae/0xcb7c48919424fb96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.304603:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a67584ae/0xcb7c48919424fb96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.304901:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548872.304991:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a67584ae/0xcb7c48919424fb96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.305001:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82135600 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548872.305006:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a67584ae/0xcb7c48919424fb96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.305016:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a67584ae/0xcb7c48919424fb96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.305035:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a67584ae/0xcb7c48919424fb96 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.305055:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.305057:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.305060:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.305223:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787548872.305231:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a67584ae/0xcb7c48919424fb96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787548872.305901:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.306062:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064a8f0f7/0xcb7c48919424fb9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.306076:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.306080:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.306086:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064a8f0f7/0xcb7c48919424fb9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.306207:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064a8f0f7/0xcb7c48919424fb9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.306219:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064a8f0f7/0xcb7c48919424fb9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.306227:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064a8f0f7/0xcb7c48919424fb9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.306275:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548872.306282:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064a8f0f7/0xcb7c48919424fb9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.306291:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82134000 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548872.306297:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064a8f0f7/0xcb7c48919424fb9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.306306:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064a8f0f7/0xcb7c48919424fb9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.306323:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064a8f0f7/0xcb7c48919424fb9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.306332:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.306334:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.306336:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.306409:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787548872.306414:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064a8f0f7/0xcb7c48919424fb9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787548872.307018:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787548872.307026:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b468d6/0xcb7c48919424fba4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.307038:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1787548872.307041:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548872.307047:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020b468d6/0xcb7c48919424fba4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.307057:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020b468d6/0xcb7c48919424fba4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.307078:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b468d6/0xcb7c48919424fba4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.307086:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020b468d6/0xcb7c48919424fba4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.307317:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787548872.307325:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020b468d6/0xcb7c48919424fba4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.307334:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82135800 already unused, calling callback (ffffffffc1679230) 00010000:00010000:3.0:1787548872.307339:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b468d6/0xcb7c48919424fba4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.307359:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b468d6/0xcb7c48919424fba4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.307376:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020b468d6/0xcb7c48919424fba4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548872.307486:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.307490:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787548872.307493:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548872.307604:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787548872.307611:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020b468d6/0xcb7c48919424fba4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548872.307639:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787548872.307984:0:15065:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1787548872.308102:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14404:x1874380431916544:12345-0@lo:5:osp-pre-1-0.0 Request processed in 96696us (99583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548872.308197:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787548872.309751:0:14404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14404:1874380431916544:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787548872.309776:0:14404:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1787548872.309836:0:14404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14404:1874380431916672:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787548872.309903:0:14404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548872.310514:0:14404:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feca0a1aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787548872.310545:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431916672 00000100:00100000:2.0:1787548872.310569:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431916672 00000100:00100000:2.0:1787548872.310641:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787548872.310652:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14404:x1874380431916672:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787548872.310708:0:15064:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1787548872.323240:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548872.331972:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14404:x1874380431916672:12345-0@lo:5:osp-pre-1-0.0 Request processed in 21300us (22048us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787548872.331988:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787548872.332062:0:14404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14404:1874380431916672:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787548872.332080:0:14404:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:3.0:1787548872.336355:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:2.0:1787548872.894497:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787548872.894510:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1787548873.351030:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548874.371338:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787548874.904097:0:16139:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg613-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787548875.396442:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548875.779463:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787548875.779482:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431916800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548875.779652:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548875.779733:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431916800 00000100:00100000:1.0:1787548875.779739:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431916800 00000100:00100000:1.0:1787548875.779789:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787548875.779798:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431916800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787548875.779830:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548875.780038:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431916800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548875.780053:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787548875.780074:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548875.780103:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431916800:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787548876.420993:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548877.316637:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3314:1874380431916928:0@lo:400:kworker.0 00000100:00100000:2.0:1787548877.316705:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548877.316796:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431917440:0@lo:400:kworker.0 00000100:00100000:2.0:1787548877.316821:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548877.316853:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787548877.316859:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431917312:0@lo:400:kworker.0 00000100:00100000:2.0:1787548877.316877:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548877.316897:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431917184:0@lo:400:kworker.0 00000100:00100000:2.0:1787548877.316918:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548877.316946:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787548877.316951:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431917056:0@lo:400:kworker.0 00000100:00100000:2.0:1787548877.316971:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548877.316986:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431917568:0@lo:400:kworker.0 00000100:00100000:2.0:1787548877.317002:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548877.317025:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431917440 00000100:00100000:2.0:1787548877.317031:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431917440 00000100:00100000:2.0:1787548877.317069:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431917312 00000100:00100000:2.0:1787548877.317072:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431917312 00000100:00100000:2.0:1787548877.317081:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431917568 00000100:00100000:2.0:1787548877.317083:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431917568 00000100:00100000:2.0:1787548877.317095:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787548877.317114:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431917440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548877.317182:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431917440:12345-0@lo:400:kworker.0 Request processed in 68us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548877.317189:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787548877.317205:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787548877.317210:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431917312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548877.317231:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431917312:12345-0@lo:400:kworker.0 Request processed in 21us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548877.317237:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787548877.317245:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787548877.317251:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431917568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548877.317272:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431917568:12345-0@lo:400:kworker.0 Request processed in 22us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548877.317278:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787548877.317310:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8833ca80 x1874380431917312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548877.317322:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431917312:0@lo:400:kworker.0 00010000:00080000:2.0:1787548877.317332:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8833fb80 x1874380431917440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548877.317339:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431917440:0@lo:400:kworker.0 00010000:00080000:2.0:1787548877.317363:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fec8833d180 x1874380431917568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787548893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787548877.317372:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431917568:0@lo:400:kworker.0 00000100:00100000:3.0:1787548877.318027:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431917696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548877.318060:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548877.318105:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431917696 00000100:00100000:3.0:1787548877.318110:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431917696 00000100:00100000:3.0:1787548877.318160:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787548877.318167:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431917696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787548877.318193:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548877.318231:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431917696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548877.318237:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787548877.318261:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787548877.318275:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431917696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548877.327433:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431917184 00000100:00100000:0.0:1787548877.327446:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431917184 00000100:00100000:0.0:1787548877.327500:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431917056 00000100:00100000:0.0:1787548877.327503:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431917056 00000100:00100000:0.0:1787548877.327531:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787548877.327540:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431917184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548877.327626:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431917184:12345-0@lo:400:kworker.0 Request processed in 87us (10707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548877.327633:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787548877.327649:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787548877.327655:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431917056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548877.327680:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431917056:12345-0@lo:400:kworker.0 Request processed in 25us (10708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548877.327685:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787548877.332202:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431917056:0@lo:400:kworker.0 00000100:00100000:2.0:1787548877.332218:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431917184:0@lo:400:kworker.0 00000100:00100000:1.0:1787548877.332817:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431916928 00000100:00100000:1.0:1787548877.332825:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431916928 00000100:00080000:1.0:1787548877.333034:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787548877.333039:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787548877.333043:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787548877.333220:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787548877.333229:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:3314:x1874380431916928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548877.333950:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:3314:x1874380431916928:12345-0@lo:400:kworker.0 Request processed in 719us (17241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548877.333960:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787548877.337035:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3314:1874380431916928:0@lo:400:kworker.0 00010000:00010000:2.0:1787548877.447613:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548877.615675:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548877.615769:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416196096 00000100:00100000:2.0:1787548877.615778:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416196096 00000100:00100000:2.0:1787548877.615828:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 77 00000100:00100000:2.0:1787548877.615835:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2350:x1874380416196096:12345-192.168.206.13@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787548877.615861:0:14374:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b3f9a8cf-27da-41c5-bc50-00f0da779636@192.168.206.13@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1787548877.615886:0:14374:0:(genops.c:1385:class_connect()) connect: client b3f9a8cf-27da-41c5-bc50-00f0da779636, cookie 0xcb7c48919424fbab 00000100:00080000:2.0:1787548877.616018:0:14374:0:(import.c:65:import_set_state_nolock()) ffff8fecacdec800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787548877.616080:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+5:2350:x1874380416196096:12345-192.168.206.13@tcp:250:mount.lustre.0 Request processed in 244us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548877.616087:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 77 00000100:00100000:1.0:1787548877.627727:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548877.628022:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416196224 00000100:00100000:2.0:1787548877.628031:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416196224 00000100:00100000:2.0:1787548877.628079:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 78 00000100:00100000:2.0:1787548877.628096:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+5:13744:x1874380416196224:12345-192.168.206.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787548877.628111:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548877.628125:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8feb81e2b600/0xcb7c48919424fbb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a25bd expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548877.628178:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8feb81e2b600/0xcb7c48919424fbb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25bd expref: 6 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548877.628189:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8feb81e2b600/0xcb7c48919424fbb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25bd expref: 6 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548877.628214:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2b600, rc 0) 00000100:00100000:2.0:1787548877.628258:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+6:13744:x1874380416196224:12345-192.168.206.13@tcp:101:mount.lustre.0 Request processed in 164us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548877.628264:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 78 00000100:00100000:3.0:1787548877.631204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548877.631281:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416196352 00000100:00100000:0.0:1787548877.631290:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416196352 00000100:00100000:0.0:1787548877.631339:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 79 00000100:00100000:0.0:1787548877.631348:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+6:13744:x1874380416196352:12345-192.168.206.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787548877.631599:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+6:13744:x1874380416196352:12345-192.168.206.13@tcp:501:mount.lustre.0 Request processed in 251us (401us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787548877.631607:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 79 00000100:00100000:1.0:1787548877.637878:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548877.638000:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416196480 00000100:00100000:3.0:1787548877.638009:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416196480 00000100:00100000:3.0:1787548877.638057:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 80 00000100:00100000:3.0:1787548877.638066:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+6:13744:x1874380416196480:12345-192.168.206.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787548877.638088:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548877.638102:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbcc93200/0xcb7c48919424fbb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a25c4 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548877.638152:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbcc93200/0xcb7c48919424fbb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25c4 expref: 7 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548877.638165:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbcc93200/0xcb7c48919424fbb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25c4 expref: 7 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548877.638174:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93200, rc 0) 00000100:00100000:3.0:1787548877.638219:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+7:13744:x1874380416196480:12345-192.168.206.13@tcp:101:mount.lustre.0 Request processed in 154us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548877.638225:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 80 00000100:00100000:1.0:1787548877.646070:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548877.646199:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416196608 00000100:00100000:2.0:1787548877.646208:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416196608 00000100:00100000:2.0:1787548877.646255:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 81 00000100:00100000:2.0:1787548877.646264:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+7:13744:x1874380416196608:12345-192.168.206.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787548877.647287:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+8:13744:x1874380416196608:12345-192.168.206.13@tcp:501:mount.lustre.0 Request processed in 1017us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548877.647297:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 81 00000100:00100000:1.0:1787548877.655661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548877.655731:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416196736 00000100:00100000:0.0:1787548877.655739:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416196736 00000100:00100000:0.0:1787548877.655787:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 82 00000100:00100000:0.0:1787548877.655796:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad09f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+8:13744:x1874380416196736:12345-192.168.206.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787548877.655995:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad09f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+8:13744:x1874380416196736:12345-192.168.206.13@tcp:503:mount.lustre.0 Request processed in 199us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548877.656003:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 82 00000100:00100000:1.0:1787548877.662006:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548877.662124:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416196864 00000100:00100000:3.0:1787548877.662178:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416196864 00000100:00100000:3.0:1787548877.662245:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 83 00000100:00100000:3.0:1787548877.662257:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+8:13763:x1874380416196864:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787548877.662612:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+8:13763:x1874380416196864:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 356us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548877.662621:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 83 00000100:00100000:1.0:1787548877.685946:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548877.686200:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416196992 00000100:00100000:2.0:1787548877.686209:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416196992 00000100:00100000:2.0:1787548877.686259:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 84 00000100:00100000:2.0:1787548877.686268:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+8:13763:x1874380416196992:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787548877.686520:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+8:13763:x1874380416196992:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 252us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548877.686527:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 84 00000100:00100000:1.0:1787548877.704284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548877.708334:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416197120 00000100:00100000:0.0:1787548877.708349:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416197120 00000100:00100000:0.0:1787548877.708544:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 85 00000100:00100000:0.0:1787548877.708557:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+8:13744:x1874380416197120:12345-192.168.206.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787548877.708572:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548877.708802:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90150a00/0xcb7c48919424fbc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a25ee expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548877.708830:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90150a00/0xcb7c48919424fbc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25ee expref: 9 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548877.708840:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90150a00/0xcb7c48919424fbc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25ee expref: 9 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548877.708849:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150a00, rc 0) 00000100:00100000:0.0:1787548877.708981:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+9:13744:x1874380416197120:12345-192.168.206.13@tcp:101:mount.lustre.0 Request processed in 426us (4704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548877.709001:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 85 00000100:00100000:1.0:1787548877.719261:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548877.719552:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416197248 00000100:00100000:3.0:1787548877.719561:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416197248 00000100:00100000:3.0:1787548877.719614:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 86 00000100:00100000:3.0:1787548877.719624:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+9:13744:x1874380416197248:12345-192.168.206.13@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787548877.719648:0:14374:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787548877.719669:0:14374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787548877.719673:0:14374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787548877.719676:0:14374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787548877.719678:0:14374:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787548877.722274:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+9:13744:x1874380416197248:12345-192.168.206.13@tcp:256:mount.lustre.0 Request processed in 2644us (3013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548877.722383:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 86 00000100:00100000:1.0:1787548877.732835:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548877.732941:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416197376 00000100:00100000:2.0:1787548877.732950:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416197376 00000100:00100000:2.0:1787548877.732993:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 87 00000100:00100000:2.0:1787548877.733002:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+9:13744:x1874380416197376:12345-192.168.206.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787548877.733015:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548877.733030:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8feb81e2ac00/0xcb7c48919424fbc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a25f5 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548877.733064:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8feb81e2ac00/0xcb7c48919424fbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25f5 expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548877.733075:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8feb81e2ac00/0xcb7c48919424fbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25f5 expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548877.733096:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2ac00, rc 0) 00000100:00100000:2.0:1787548877.733170:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+10:13744:x1874380416197376:12345-192.168.206.13@tcp:101:mount.lustre.0 Request processed in 168us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548877.733176:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 87 00000100:00100000:1.0:1787548877.740232:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548877.740306:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416197504 00000100:00100000:3.0:1787548877.740315:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416197504 00000100:00100000:3.0:1787548877.740368:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 88 00000100:00100000:3.0:1787548877.740377:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+10:13744:x1874380416197504:12345-192.168.206.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787548877.740644:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+10:13744:x1874380416197504:12345-192.168.206.13@tcp:501:mount.lustre.0 Request processed in 267us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548877.740653:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 88 00000100:00100000:1.0:1787548877.743444:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548877.743530:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416197632 00000100:00100000:0.0:1787548877.743538:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416197632 00000100:00100000:0.0:1787548877.743584:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 89 00000100:00100000:0.0:1787548877.743593:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+10:13744:x1874380416197632:12345-192.168.206.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787548877.743848:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+10:13744:x1874380416197632:12345-192.168.206.13@tcp:503:mount.lustre.0 Request processed in 254us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548877.743856:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 89 00000100:00100000:1.0:1787548877.750659:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548877.750744:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416197760 00000100:00100000:2.0:1787548877.750753:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416197760 00000100:00100000:2.0:1787548877.750802:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 90 00000100:00100000:2.0:1787548877.750811:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+10:13764:x1874380416197760:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787548877.751060:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+10:13764:x1874380416197760:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 249us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548877.751068:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 90 00000100:00100000:1.0:1787548877.757230:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548877.757341:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416197888 00000100:00100000:3.0:1787548877.757350:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416197888 00000100:00100000:3.0:1787548877.757398:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 91 00000100:00100000:3.0:1787548877.757407:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+10:13764:x1874380416197888:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787548877.757784:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+10:13764:x1874380416197888:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 377us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548877.757792:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 91 00000100:00100000:0.0:1787548877.766488:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548877.769031:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416198016 00000100:00100000:2.0:1787548877.769044:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416198016 00000100:00100000:2.0:1787548877.769109:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 4 00000100:00100000:2.0:1787548877.769117:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1874380416198016:12345-192.168.206.13@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787548877.769167:0:14380:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 555100d0-5cca-42dc-9b2b-8251df4fed16@192.168.206.13@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1787548877.769213:0:14380:0:(genops.c:1385:class_connect()) connect: client 555100d0-5cca-42dc-9b2b-8251df4fed16, cookie 0xcb7c48919424fbce 00000004:00100000:2.0:1787548877.769239:0:14380:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787548877.769244:0:14380:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1787548877.825579:0:14380:0:(import.c:65:import_set_state_nolock()) ffff8fecb5287000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787548877.825678:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+6:2350:x1874380416198016:12345-192.168.206.13@tcp:38:mount.lustre.0 Request processed in 56559us (59197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548877.825689:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 4 00000100:00100000:1.0:1787548877.830105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548877.830168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548877.830227:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416198144 00000100:00100000:3.0:1787548877.830236:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416198144 00000100:00100000:3.0:1787548877.830292:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416198272 00000100:00100000:3.0:1787548877.830295:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416198272 00000100:00100000:3.0:1787548877.830312:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 5 00000100:00100000:3.0:1787548877.830320:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+7:0:x1874380416198144:12345-192.168.206.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787548877.830357:0:15793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787548877.830429:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+7:0:x1874380416198144:12345-192.168.206.13@tcp:41:mount.lustre.0 Request processed in 109us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548877.830436:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 5 00000100:00100000:3.0:1787548877.830452:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 6 00000100:00100000:3.0:1787548877.830457:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+6:13744:x1874380416198272:12345-192.168.206.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787548877.830466:0:15793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1787548877.830661:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548877.830683:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+6:13744:x1874380416198272:12345-192.168.206.13@tcp:41:mount.lustre.0 Request processed in 27us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548877.830692:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 6 00000100:00100000:2.0:1787548877.838254:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548877.838339:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416198400 00000100:00100000:3.0:1787548877.838348:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416198400 00000100:00100000:3.0:1787548877.838403:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:3.0:1787548877.838412:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+6:13744:x1874380416198400:12345-192.168.206.13@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787548877.838497:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+6:13744:x1874380416198400:12345-192.168.206.13@tcp:40:mount.lustre.0 Request processed in 85us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548877.838524:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:3.0:1787548877.840809:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548877.840845:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548877.840873:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548877.840961:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416198528 00000100:00100000:0.0:1787548877.840970:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416198528 00000100:00100000:0.0:1787548877.841001:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416198656 00000100:00100000:0.0:1787548877.841004:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416198656 00000100:00100000:0.0:1787548877.841021:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00100000:0.0:1787548877.841030:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1874380416198528:12345-192.168.206.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787548877.841057:0:15065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 555100d0-5cca-42dc-9b2b-8251df4fed16@192.168.206.13@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:0.0:1787548877.841093:0:15065:0:(genops.c:1385:class_connect()) connect: client 555100d0-5cca-42dc-9b2b-8251df4fed16, cookie 0xcb7c48919424fbd5 00002000:00100000:0.0:1787548877.841105:0:15065:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 555100d0-5cca-42dc-9b2b-8251df4fed16/ffff8feb81d2f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787548877.841125:0:15065:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787548877.841433:0:15065:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787548877.841459:0:15065:0:(import.c:65:import_set_state_nolock()) ffff8feb81d2c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787548877.841522:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+6:2350:x1874380416198528:12345-192.168.206.13@tcp:8:mount.lustre.0 Request processed in 492us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548877.841530:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00100000:0.0:1787548877.841546:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:0.0:1787548877.841562:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1874380416198656:12345-192.168.206.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787548877.841576:0:15065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 555100d0-5cca-42dc-9b2b-8251df4fed16@192.168.206.13@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:0.0:1787548877.841591:0:15065:0:(genops.c:1385:class_connect()) connect: client 555100d0-5cca-42dc-9b2b-8251df4fed16, cookie 0xcb7c48919424fbdc 00002000:00100000:0.0:1787548877.841596:0:15065:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 555100d0-5cca-42dc-9b2b-8251df4fed16/ffff8feb81d2e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787548877.841602:0:15065:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787548877.841784:0:15065:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787548877.841798:0:15065:0:(import.c:65:import_set_state_nolock()) ffff8feb81d2a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787548877.841819:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+6:2350:x1874380416198656:12345-192.168.206.13@tcp:8:mount.lustre.0 Request processed in 257us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548877.841826:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:2.0:1787548877.842153:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416198784 00000100:00100000:2.0:1787548877.842159:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416198784 00000100:00100000:2.0:1787548877.842196:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 0 00000100:00100000:2.0:1787548877.842203:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+6:13744:x1874380416198784:12345-192.168.206.13@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787548877.852568:0:14382:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9887us 00000004:00200000:2.0:1787548877.876068:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787548877.877105:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+6:13744:x1874380416198784:12345-192.168.206.13@tcp:33:mount.lustre.0 Request processed in 34895us (36296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548877.877118:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 0 00000040:00080000:2.0:1787548878.023112:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787548878.039077:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548878.039216:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416198912 00000100:00100000:0.0:1787548878.039226:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416198912 00000100:00100000:0.0:1787548878.039280:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 8 00000100:00100000:0.0:1787548878.039288:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+6:13786:x1874380416198912:12345-192.168.206.13@tcp:101:mkdir.0 00010000:00010000:0.0:1787548878.039309:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548878.039332:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fbe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a261f expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548878.039395:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fbea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548878.039418:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fbea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548878.039432:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fbea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548878.039881:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787548878.039886:0:14381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548878.039987:0:14381:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fbea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548878.040016:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fbe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a261f expref: 8 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548878.040032:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fbea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a261f expref: 7 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548878.040041:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:0.0:1787548878.040044:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787548878.040047:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151c00, rc 0) 00000100:00100000:0.0:1787548878.040113:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+7:13786:x1874380416198912:12345-192.168.206.13@tcp:101:mkdir.0 Request processed in 825us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548878.040120:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 8 00010000:00010000:3.0:1787548878.472206:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548879.491443:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548880.416778:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548880.417878:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416199040 00000100:00100000:0.0:1787548880.417892:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416199040 00000100:00100000:0.0:1787548880.417980:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00100000:0.0:1787548880.417991:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+7:13838:x1874380416199040:12345-192.168.206.13@tcp:41:lfs.0 00000004:00000024:0.0:1787548880.418032:0:15793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787548880.418158:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+7:13838:x1874380416199040:12345-192.168.206.13@tcp:41:lfs.0 Request processed in 168us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548880.418165:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00080000:1.0:1787548880.418534:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548880.427093:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548880.427183:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416199168 00000100:00100000:3.0:1787548880.427195:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416199168 00000100:00100000:3.0:1787548880.427264:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 6 00000100:00100000:3.0:1787548880.427275:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:555100d0-5cca-42dc-9b2b-8251df4fed16+6:13838:x1874380416199168:12345-192.168.206.13@tcp:13:lfs.0 00002000:00000024:3.0:1787548880.427311:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548880.427396:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:555100d0-5cca-42dc-9b2b-8251df4fed16+6:13838:x1874380416199168:12345-192.168.206.13@tcp:13:lfs.0 Request processed in 123us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548880.427404:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 6 00000100:00080000:1.0:1787548880.427468:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787548880.430221:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548880.430321:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416199296 00000100:00100000:3.0:1787548880.430330:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416199296 00000100:00100000:3.0:1787548880.430414:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:3.0:1787548880.430425:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:555100d0-5cca-42dc-9b2b-8251df4fed16+6:13838:x1874380416199296:12345-192.168.206.13@tcp:13:lfs.0 00002000:00000024:3.0:1787548880.430462:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548880.430547:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:555100d0-5cca-42dc-9b2b-8251df4fed16+6:13838:x1874380416199296:12345-192.168.206.13@tcp:13:lfs.0 Request processed in 123us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548880.430553:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00080000:1.0:1787548880.430624:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787548880.516344:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548880.689373:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548880.689488:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416199424 00000100:00100000:2.0:1787548880.689497:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416199424 00000100:00100000:2.0:1787548880.689556:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 92 00000100:00100000:2.0:1787548880.689567:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+10:13868:x1874380416199424:12345-192.168.206.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787548880.689586:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548880.689605:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8feb81e2a800/0xcb7c48919424fbf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2626 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548880.689635:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8feb81e2a800/0xcb7c48919424fbf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2626 expref: 11 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548880.689647:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8feb81e2a800/0xcb7c48919424fbf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2626 expref: 11 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548880.689657:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2a800, rc 0) 00000100:00100000:2.0:1787548880.689716:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+11:13868:x1874380416199424:12345-192.168.206.13@tcp:101:mount.lustre.0 Request processed in 151us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548880.689738:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 92 00000100:00100000:0.0:1787548880.693879:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548880.693972:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416199552 00000100:00100000:3.0:1787548880.693984:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416199552 00000100:00100000:3.0:1787548880.694036:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 93 00000100:00100000:3.0:1787548880.694064:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb355cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+11:13868:x1874380416199552:12345-192.168.206.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787548880.694422:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb355cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+11:13868:x1874380416199552:12345-192.168.206.13@tcp:501:mount.lustre.0 Request processed in 360us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548880.694431:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 93 00000100:00100000:0.0:1787548880.699417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548880.699612:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416199680 00000100:00100000:3.0:1787548880.699623:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416199680 00000100:00100000:3.0:1787548880.699680:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 94 00000100:00100000:3.0:1787548880.699690:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+11:13868:x1874380416199680:12345-192.168.206.13@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787548880.700319:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+11:13868:x1874380416199680:12345-192.168.206.13@tcp:503:mount.lustre.0 Request processed in 628us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548880.700329:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 94 00000100:00100000:0.0:1787548880.716549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548880.723707:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416199808 00000100:00100000:2.0:1787548880.723725:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416199808 00000100:00100000:2.0:1787548880.724210:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 95 00000100:00100000:2.0:1787548880.724222:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+11:13876:x1874380416199808:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787548880.725927:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+11:13876:x1874380416199808:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 1686us (9373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548880.725941:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 95 00000100:00100000:0.0:1787548880.765263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548880.765484:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416199936 00000100:00100000:1.0:1787548880.765493:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416199936 00000100:00100000:1.0:1787548880.765546:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 96 00000100:00100000:1.0:1787548880.765555:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+11:13876:x1874380416199936:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787548880.765803:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+11:13876:x1874380416199936:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 247us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548880.765811:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 96 00000100:00100000:1.0:1787548880.781707:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548880.781825:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416200064 00000100:00100000:0.0:1787548880.781835:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416200064 00000100:00100000:0.0:1787548880.781890:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 97 00000100:00100000:0.0:1787548880.781901:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+11:13868:x1874380416200064:12345-192.168.206.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787548880.781929:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548880.781948:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90150400/0xcb7c48919424fbf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2650 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548880.781979:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90150400/0xcb7c48919424fbf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2650 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548880.781991:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90150400/0xcb7c48919424fbf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2650 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548880.782001:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150400, rc 0) 00000100:00100000:0.0:1787548880.782077:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+12:13868:x1874380416200064:12345-192.168.206.13@tcp:101:mount.lustre.0 Request processed in 177us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548880.782084:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 97 00000100:00100000:2.0:1787548880.796384:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548880.796701:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416200192 00000100:00100000:0.0:1787548880.796712:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416200192 00000100:00100000:0.0:1787548880.796775:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 98 00000100:00100000:0.0:1787548880.796783:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+12:13868:x1874380416200192:12345-192.168.206.13@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787548880.796808:0:14374:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787548880.796828:0:14374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787548880.796832:0:14374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787548880.796835:0:14374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787548880.796838:0:14374:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787548880.804991:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+12:13868:x1874380416200192:12345-192.168.206.13@tcp:256:mount.lustre.0 Request processed in 8196us (8606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548880.805006:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 98 00000100:00100000:2.0:1787548880.809794:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548880.812922:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416200320 00000100:00100000:1.0:1787548880.812937:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416200320 00000100:00100000:1.0:1787548880.812990:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 99 00000100:00100000:1.0:1787548880.813000:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+12:13868:x1874380416200320:12345-192.168.206.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787548880.813015:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548880.813032:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8feb82135a00/0xcb7c48919424fbff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2657 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548880.813057:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8feb82135a00/0xcb7c48919424fbff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2657 expref: 13 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548880.813089:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8feb82135a00/0xcb7c48919424fbff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2657 expref: 13 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548880.813099:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb82135a00, rc 0) 00000100:00100000:1.0:1787548880.813172:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:13868:x1874380416200320:12345-192.168.206.13@tcp:101:mount.lustre.0 Request processed in 174us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548880.813179:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 99 00000100:00100000:2.0:1787548880.816010:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548880.816103:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416200448 00000100:00100000:0.0:1787548880.816113:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416200448 00000100:00100000:0.0:1787548880.816188:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 100 00000100:00100000:0.0:1787548880.816198:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:13868:x1874380416200448:12345-192.168.206.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787548880.816489:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:13868:x1874380416200448:12345-192.168.206.13@tcp:501:mount.lustre.0 Request processed in 291us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548880.816497:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 100 00000100:00100000:3.0:1787548880.823623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548880.823792:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416200576 00000100:00100000:0.0:1787548880.823803:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416200576 00000100:00100000:0.0:1787548880.823873:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 101 00000100:00100000:0.0:1787548880.823884:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:13868:x1874380416200576:12345-192.168.206.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787548880.824345:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:13868:x1874380416200576:12345-192.168.206.13@tcp:503:mount.lustre.0 Request processed in 461us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548880.824353:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 101 00000100:00100000:2.0:1787548880.832844:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548880.833817:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416200704 00000100:00100000:1.0:1787548880.833828:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416200704 00000100:00100000:1.0:1787548880.833879:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 102 00000100:00100000:1.0:1787548880.833887:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:13880:x1874380416200704:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787548880.834211:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:13880:x1874380416200704:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 323us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548880.834219:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 102 00000100:00100000:2.0:1787548880.848340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548880.848555:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416200832 00000100:00100000:0.0:1787548880.848567:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416200832 00000100:00100000:0.0:1787548880.848695:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 103 00000100:00100000:0.0:1787548880.848705:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:13880:x1874380416200832:12345-192.168.206.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787548880.848986:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:13880:x1874380416200832:12345-192.168.206.13@tcp:502:llog_process_th.0 Request processed in 281us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548880.848995:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 103 00000100:00100000:0.0:1787548880.864897:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548880.864982:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416200960 00000100:00100000:3.0:1787548880.864991:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416200960 00000100:00100000:3.0:1787548880.865032:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:3.0:1787548880.865040:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1874380416200960:12345-192.168.206.13@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787548880.865069:0:14380:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cb279855-398c-4aa8-baf4-2aafd9b9b5c7@192.168.206.13@tcp t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:3.0:1787548880.865112:0:14380:0:(genops.c:1385:class_connect()) connect: client cb279855-398c-4aa8-baf4-2aafd9b9b5c7, cookie 0xcb7c48919424fc06 00000004:00100000:3.0:1787548880.865170:0:14380:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787548880.865272:0:14380:0:(import.c:65:import_set_state_nolock()) ffff8fecb49b5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787548880.865334:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:2350:x1874380416200960:12345-192.168.206.13@tcp:38:mount.lustre.0 Request processed in 293us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548880.865342:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:2.0:1787548880.881390:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548880.881927:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416201088 00000100:00100000:0.0:1787548880.881937:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416201088 00000100:00100000:0.0:1787548880.882018:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:0.0:1787548880.882028:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:0:x1874380416201088:12345-192.168.206.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787548880.882058:0:15793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787548880.882175:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:0:x1874380416201088:12345-192.168.206.13@tcp:41:mount.lustre.0 Request processed in 147us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548880.882183:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00080000:1.0:1787548880.882907:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548880.886342:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548880.886521:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416201216 00000100:00100000:3.0:1787548880.886531:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416201216 00000100:00100000:3.0:1787548880.886600:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:3.0:1787548880.886610:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:13868:x1874380416201216:12345-192.168.206.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787548880.886642:0:14380:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787548880.886710:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:13868:x1874380416201216:12345-192.168.206.13@tcp:41:mount.lustre.0 Request processed in 101us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548880.886718:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:0.0:1787548880.899555:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431917824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548880.899633:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548880.901637:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431917824 00000100:00100000:3.0:1787548880.901651:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431917824 00000100:00100000:3.0:1787548880.901718:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787548880.901822:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787548880.902017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548880.902155:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416201344 00000100:00100000:1.0:1787548880.902160:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416201344 00000100:00100000:1.0:1787548880.902202:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 13 00000100:00100000:1.0:1787548880.902212:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:13868:x1874380416201344:12345-192.168.206.13@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787548880.902293:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:13868:x1874380416201344:12345-192.168.206.13@tcp:40:mount.lustre.0 Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548880.902301:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 13 00000100:00100000:1.0:1787548880.903440:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431917824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787548880.903490:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548880.903564:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431917824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 610us (3931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548880.903571:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787548880.903756:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431917824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787548880.906397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548880.906438:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548880.906479:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548880.906626:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416201472 00000100:00100000:0.0:1787548880.906637:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416201472 00000100:00100000:0.0:1787548880.906683:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416201600 00000100:00100000:0.0:1787548880.906686:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416201600 00000100:00100000:0.0:1787548880.906708:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:0.0:1787548880.906716:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1874380416201472:12345-192.168.206.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787548880.906763:0:15065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cb279855-398c-4aa8-baf4-2aafd9b9b5c7@192.168.206.13@tcp t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:0.0:1787548880.906799:0:15065:0:(genops.c:1385:class_connect()) connect: client cb279855-398c-4aa8-baf4-2aafd9b9b5c7, cookie 0xcb7c48919424fc0d 00002000:00100000:0.0:1787548880.906827:0:15065:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cb279855-398c-4aa8-baf4-2aafd9b9b5c7/ffff8feb81d2a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787548880.906838:0:15065:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787548880.906955:0:15065:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787548880.906985:0:15065:0:(import.c:65:import_set_state_nolock()) ffff8feb81d2f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787548880.907048:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:2350:x1874380416201472:12345-192.168.206.13@tcp:8:mount.lustre.0 Request processed in 331us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548880.907056:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:0.0:1787548880.907088:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:0.0:1787548880.907094:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1874380416201600:12345-192.168.206.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787548880.907109:0:15065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cb279855-398c-4aa8-baf4-2aafd9b9b5c7@192.168.206.13@tcp t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:0.0:1787548880.907124:0:15065:0:(genops.c:1385:class_connect()) connect: client cb279855-398c-4aa8-baf4-2aafd9b9b5c7, cookie 0xcb7c48919424fc14 00002000:00100000:0.0:1787548880.907162:0:15065:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cb279855-398c-4aa8-baf4-2aafd9b9b5c7/ffff8feb81d28800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787548880.907169:0:15065:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787548880.907231:0:15065:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787548880.907247:0:15065:0:(import.c:65:import_set_state_nolock()) ffff8feb81d29000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787548880.907273:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:2350:x1874380416201600:12345-192.168.206.13@tcp:8:mount.lustre.0 Request processed in 178us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548880.907279:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:3.0:1787548880.908183:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416201728 00000100:00100000:3.0:1787548880.908191:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416201728 00000100:00100000:3.0:1787548880.908230:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 1 00000100:00100000:3.0:1787548880.908237:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:13868:x1874380416201728:12345-192.168.206.13@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787548880.909634:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787548880.909945:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:13868:x1874380416201728:12345-192.168.206.13@tcp:33:mount.lustre.0 Request processed in 1704us (3553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548880.909955:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 1 00000100:00100000:2.0:1787548881.176732:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548881.176956:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416201856 00000100:00100000:3.0:1787548881.176967:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416201856 00000100:00100000:3.0:1787548881.177030:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:3.0:1787548881.177040:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:13901:x1874380416201856:12345-192.168.206.13@tcp:101:mkdir.0 00010000:00010000:3.0:1787548881.177061:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548881.177084:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424fc1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2681 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548881.177191:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424fc22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548881.177223:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424fc22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548881.177237:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424fc22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548881.177422:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787548881.177427:0:14380:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787548881.177535:0:14380:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424fc22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548881.177565:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424fc1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2681 expref: 8 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548881.177582:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424fc22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2681 expref: 7 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548881.177591:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:3.0:1787548881.177594:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787548881.177597:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92e00, rc 0) 00000100:00100000:3.0:1787548881.177668:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+7:13901:x1874380416201856:12345-192.168.206.13@tcp:101:mkdir.0 Request processed in 629us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548881.177675:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 14 00010000:00010000:2.0:1787548881.539365:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787548882.015608:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cb279855-398c-4aa8-baf4-2aafd9b9b5c7 00000001:00100000:2.0:1787548882.015623:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 555100d0-5cca-42dc-9b2b-8251df4fed16 00000100:00100000:0.0:1787548882.435312:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787548882.435332:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431917952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548882.435394:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548882.435592:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431917952 00000100:00100000:3.0:1787548882.435600:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431917952 00000100:00100000:3.0:1787548882.435662:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787548882.435671:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431917952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787548882.435703:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787548882.435750:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431917952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548882.435757:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787548882.436200:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787548882.436235:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431917952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548882.436773:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431918464:0@lo:400:kworker.0 00000100:00100000:0.0:1787548882.436824:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548882.436849:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787548882.436854:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431918336:0@lo:400:kworker.0 00000100:00100000:0.0:1787548882.436881:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548882.436916:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431918464 00000100:00100000:0.0:1787548882.436921:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431918464 00000100:00100000:0.0:1787548882.436955:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431918336 00000100:00100000:0.0:1787548882.436958:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431918336 00000100:00100000:0.0:1787548882.436975:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787548882.436982:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431918464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548882.437019:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431918464:12345-0@lo:400:kworker.0 Request processed in 37us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548882.437026:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787548882.437038:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787548882.437044:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431918336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548882.437076:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431918336:12345-0@lo:400:kworker.0 Request processed in 32us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548882.437082:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1787548882.437103:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548882.437120:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431918336:0@lo:400:kworker.0 00000100:00100000:0.0:1787548882.437150:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431918464:0@lo:400:kworker.0 00000100:00100000:2.0:1787548882.437361:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431918208:0@lo:400:kworker.0 00000100:00100000:2.0:1787548882.437394:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548882.437420:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787548882.437425:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3316:1874380431918080:0@lo:400:kworker.0 00000100:00100000:2.0:1787548882.437451:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548882.437480:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431918592:0@lo:400:kworker.0 00000100:00100000:2.0:1787548882.437499:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548882.437556:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431918208 00000100:00100000:0.0:1787548882.437559:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431918208 00000100:00100000:0.0:1787548882.437597:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787548882.437603:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431918208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548882.437641:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431918208:12345-0@lo:400:kworker.0 Request processed in 38us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548882.437654:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787548882.437686:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431918208:0@lo:400:kworker.0 00000100:00100000:0.0:1787548882.437702:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431918592 00000100:00100000:0.0:1787548882.437705:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431918592 00000100:00100000:0.0:1787548882.437729:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787548882.437735:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431918592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548882.437771:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874380431918592:12345-0@lo:400:kworker.0 Request processed in 36us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548882.437776:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787548882.437802:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874380431918592:0@lo:400:kworker.0 00000100:00080000:2.0:1787548882.438574:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787548882.438581:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787548882.438668:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431918080 00000100:00100000:3.0:1787548882.438675:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431918080 00000100:00100000:3.0:1787548882.438721:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787548882.438729:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:3316:x1874380431918080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787548882.438794:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:3316:x1874380431918080:12345-0@lo:400:kworker.0 Request processed in 66us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548882.438801:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787548882.439005:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3316:1874380431918080:0@lo:400:kworker.0 00010000:00010000:1.0:1787548882.564024:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787548883.041822:0:5878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 555100d0-5cca-42dc-9b2b-8251df4fed16 00000001:00100000:0.0:1787548883.041838:0:5878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cb279855-398c-4aa8-baf4-2aafd9b9b5c7 00000001:00100000:0.0:1787548883.058025:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cb279855-398c-4aa8-baf4-2aafd9b9b5c7 00000001:00100000:0.0:1787548883.058042:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 555100d0-5cca-42dc-9b2b-8251df4fed16 00010000:00010000:2.0:1787548883.587344:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548884.613085:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787548884.892495:0:16344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787548885.635626:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548886.019505:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431918720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548886.019576:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548886.019652:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431918720 00000100:00100000:1.0:1787548886.019659:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431918720 00000100:00100000:1.0:1787548886.019710:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787548886.019720:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431918720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787548886.019754:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787548886.019798:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431918720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548886.019806:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787548886.019826:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548886.019862:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431918720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548886.083831:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548886.083896:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548886.083927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548886.083947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548886.083966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548886.083986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548886.084015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548886.084041:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416202240 00000100:00100000:0.0:1787548886.084050:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416202240 00000100:00100000:0.0:1787548886.084107:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416202752 00000100:00100000:0.0:1787548886.084111:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416202752 00000100:00100000:0.0:1787548886.084124:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416202368 00000100:00100000:0.0:1787548886.084126:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416202368 00000100:00100000:0.0:1787548886.084161:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416202624 00000100:00100000:0.0:1787548886.084164:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416202624 00000100:00100000:0.0:1787548886.084178:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 5 00000100:00100000:0.0:1787548886.084187:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+5:2353:x1874380416202240:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548886.084274:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+5:2353:x1874380416202240:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 88us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548886.084283:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 5 00000100:00100000:0.0:1787548886.084299:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 6 00000100:00100000:0.0:1787548886.084305:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2353:x1874380416202752:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548886.084329:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2353:x1874380416202752:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 25us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548886.084335:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 6 00000100:00100000:0.0:1787548886.084346:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:0.0:1787548886.084351:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+5:2353:x1874380416202368:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548886.084373:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+5:2353:x1874380416202368:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 22us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548886.084380:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:0.0:1787548886.084390:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 8 00000100:00100000:0.0:1787548886.084396:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2353:x1874380416202624:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548886.084416:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2353:x1874380416202624:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 21us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548886.084431:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 8 00000100:00100000:0.0:1787548886.084452:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416202496 00000100:00100000:0.0:1787548886.084455:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416202496 00000100:00100000:0.0:1787548886.084479:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416202112 00000100:00100000:0.0:1787548886.084482:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416202112 00000100:00100000:0.0:1787548886.084500:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 19 00000100:00100000:0.0:1787548886.084506:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:2353:x1874380416202496:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548886.084533:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:2353:x1874380416202496:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 27us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548886.084539:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 19 00000100:00100000:0.0:1787548886.084550:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00100000:0.0:1787548886.084556:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+6:2353:x1874380416202112:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548886.084578:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+6:2353:x1874380416202112:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 22us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548886.084585:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00080000:0.0:1787548886.084619:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787548886.084624:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787548886.084626:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548886.085895:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416201984 00000100:00100000:1.0:1787548886.085906:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416201984 00000100:00100000:1.0:1787548886.085956:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 105 00000100:00100000:1.0:1787548886.085965:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:2353:x1874380416201984:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548886.086022:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:2353:x1874380416201984:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 58us (2200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548886.086029:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 105 00010000:00010000:1.0:1787548886.664339:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548887.555729:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431918848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548887.555809:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548887.555936:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431918848 00000100:00100000:2.0:1787548887.555944:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431918848 00000100:00100000:2.0:1787548887.556005:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787548887.556014:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431918848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787548887.556056:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548887.556105:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431918848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548887.556112:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787548887.556458:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787548887.556495:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431918848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548887.556750:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431919104:0@lo:400:kworker.0 00000100:00100000:3.0:1787548887.556797:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548887.556817:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787548887.556823:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431919232:0@lo:400:kworker.0 00000100:00100000:3.0:1787548887.556843:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548887.557891:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431919104 00000100:00100000:0.0:1787548887.557901:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431919104 00000100:00100000:0.0:1787548887.557963:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787548887.557973:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431919104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548887.558057:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874380431919104:12345-0@lo:400:kworker.0 Request processed in 86us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548887.558064:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787548887.558088:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431919232 00000100:00100000:0.0:1787548887.558092:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431919232 00000100:00100000:0.0:1787548887.558118:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787548887.558124:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431919232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548887.558180:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874380431919232:12345-0@lo:400:kworker.0 Request processed in 56us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548887.558186:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787548887.558212:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3314:1874380431918976:0@lo:400:kworker.0 00000100:00100000:0.0:1787548887.558409:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548887.558507:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874380431919232:0@lo:400:kworker.0 00000100:00100000:3.0:1787548887.558520:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874380431919104:0@lo:400:kworker.0 00000100:00100000:1.0:1787548887.558668:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431919360:0@lo:400:kworker.0 00000100:00100000:1.0:1787548887.558702:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548887.558939:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874380431919488:0@lo:400:kworker.0 00000100:00100000:0.0:1787548887.558965:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548887.558996:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431919360 00000100:00100000:0.0:1787548887.559000:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431919360 00000100:00100000:0.0:1787548887.559046:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431919488 00000100:00100000:0.0:1787548887.559050:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431919488 00000100:00100000:0.0:1787548887.559069:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787548887.559076:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431919360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548887.559115:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874380431919360:12345-0@lo:400:kworker.0 Request processed in 40us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548887.559121:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787548887.559150:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787548887.559156:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874380431919488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548887.559185:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874380431919488:12345-0@lo:400:kworker.0 Request processed in 29us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548887.559199:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787548887.559218:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548887.559237:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874380431919360:0@lo:400:kworker.0 00000100:00100000:0.0:1787548887.559274:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874380431919488:0@lo:400:kworker.0 00000100:00100000:2.0:1787548887.570341:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431918976 00000100:00100000:2.0:1787548887.570356:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431918976 00000100:00100000:0.0:1787548887.570506:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787548887.570517:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:3314:x1874380431918976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548887.570610:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:3314:x1874380431918976:12345-0@lo:400:kworker.0 Request processed in 95us (12200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548887.570617:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787548887.571952:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3314:1874380431918976:0@lo:400:kworker.0 00010000:00010000:2.0:1787548887.683836:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787548888.259970:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787548888.713983:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548889.739983:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787548889.748377:0:16493:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc4598ee0 20000000:00000080:3.0:1787548889.748396:0:16493:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8feb81d99800 uarg=0000000000000000 20000000:01000000:3.0:1787548889.748434:0:16493:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787548889.748441:0:16493:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787548889.748445:0:16493:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787548889.756185:0:16494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787548889.756467:0:16493:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787548889.765393:0:16493:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787548889.766500:0:16493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548889.766521:0:16493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f919 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548889.766545:0:16493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fecbd22f200/0xcb7c48919424f96d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424f966 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548889.766553:0:16493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8feb81e2b000/0xcb7c48919424faa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424faa1 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548889.766563:0:16493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8feb81e2ac00/0xcb7c48919424fbc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25f5 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548889.766570:0:16493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8feb82135a00/0xcb7c48919424fbff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2657 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548889.766608:0:16493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548889.766650:0:16493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8feb82135a00/0xcb7c48919424fbff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2657 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548889.766666:0:16493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8feb82135a00/0xcb7c48919424fbff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2657 expref: 12 pid: 14371 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548889.766682:0:16493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16493:1874380431919616:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548889.769779:0:16493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8feb81e2ac00/0xcb7c48919424fbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25f5 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548889.769800:0:16493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8feb81e2ac00/0xcb7c48919424fbc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25f5 expref: 12 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548889.769817:0:16493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16493:1874380431919744:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548889.769925:0:16493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8feb81e2b000/0xcb7c48919424faa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424faa1 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548889.769933:0:16493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8feb81e2b000/0xcb7c48919424faa8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424faa1 expref: 18 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548889.769941:0:16493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16493:1874380431919872:0@lo:104: 00000100:00100000:0.0:1787548889.769979:0:16493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787548889.770017:0:16493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fecbd22f200/0xcb7c48919424f96d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424f966 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548889.770449:0:16493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fecbd22f200/0xcb7c48919424f96d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424f966 expref: 18 pid: 14371 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548889.770459:0:16493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16493:1874380431920000:0@lo:104: 00000100:00100000:0.0:1787548889.770485:0:16493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787548889.770518:0:16493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb7c48919424f919 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548889.770527:0:16493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f920 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb7c48919424f919 expref: 18 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548889.770548:0:16493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a85180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16493:1874380431920128:0@lo:104: 00000100:00100000:0.0:1787548889.770572:0:16493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548889.771051:0:14362:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787548889.771066:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431919872 00000100:00100000:1.0:1787548889.771073:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431919872 00000100:00100000:1.0:1787548889.771112:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431920000 00000100:00100000:1.0:1787548889.771115:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431920000 00000100:00100000:1.0:1787548889.771125:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431920128 00000100:00100000:1.0:1787548889.771127:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431920128 00000100:00100000:1.0:1787548889.771161:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787548889.771179:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+5:16493:x1874380431919872:12345-0@lo:104: 00010000:00010000:1.0:1787548889.771192:0:14362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424faa8 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771253:0:14362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787548889.771259:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+5:16493:x1874380431919872:12345-0@lo:104: Request processed in 91us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548889.771267:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787548889.771283:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787548889.771288:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+4:16493:x1874380431920000:12345-0@lo:104: 00010000:00010000:1.0:1787548889.771296:0:14362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424f96d expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771327:0:14362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787548889.771331:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+4:16493:x1874380431920000:12345-0@lo:104: Request processed in 44us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548889.771337:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787548889.771360:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787548889.771366:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+3:16493:x1874380431920128:12345-0@lo:104: 00010000:00010000:1.0:1787548889.771373:0:14362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424f920 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771399:0:14362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787548889.771404:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+3:16493:x1874380431920128:12345-0@lo:104: Request processed in 39us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548889.771410:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787548889.771446:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787548889.771452:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424faa8 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771459:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc92400 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:1.0:1787548889.771462:0:14367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424faa8 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771470:0:14367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424faa8 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548889.771476:0:14367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424faa8 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548889.771481:0:14367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787548889.771507:0:14367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424faa8 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771513:0:14367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548889.771530:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424faa8 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771546:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecbcc92400/0xcb7c48919424faa1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424faa8 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771559:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787548889.771562:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424f96d expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771567:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbcc93600 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:1.0:1787548889.771570:0:14367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424f96d expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771577:0:14367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424f96d expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548889.771596:0:14367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424f96d expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548889.771601:0:14367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787548889.771614:0:14367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f96d expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771620:0:14367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548889.771627:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f96d expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771632:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecbcc93600/0xcb7c48919424f966 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f96d expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771640:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787548889.771649:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb7c48919424f920 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771655:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fecbd22ec00 already unused, calling callback (ffffffffc1c96c20) 10000000:00010000:1.0:1787548889.771658:0:14367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb7c48919424f920 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771664:0:14367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb7c48919424f920 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787548889.771670:0:14367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb7c48919424f920 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787548889.771675:0:14367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787548889.771688:0:14367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f920 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771692:0:14367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787548889.771707:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f920 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771713:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.113@tcp lock: ffff8fecbd22ec00/0xcb7c48919424f919 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb7c48919424f920 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.771726:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548889.771728:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787548889.771729:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548889.771749:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431920256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787548889.771779:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548889.771806:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3316:1874380431920384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787548889.771836:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548889.771857:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3313:1874380431920512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787548889.771892:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548889.771924:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431920256 00000100:00100000:1.0:1787548889.771929:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431920256 00010000:00010000:1.0:1787548889.771948:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8feb81e2b000/0xcb7c48919424faa8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424faa1 expref: 19 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548889.771961:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431920384 00000100:00100000:1.0:1787548889.771963:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431920384 00010000:00010000:1.0:1787548889.771974:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fecbd22f200/0xcb7c48919424f96d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424f966 expref: 20 pid: 14371 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548889.771982:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431920512 00000100:00100000:1.0:1787548889.771984:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431920512 00010000:00010000:1.0:1787548889.771992:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f920 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424f919 expref: 21 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548889.772002:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787548889.772007:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+21:3315:x1874380431920256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787548889.772016:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548889.772021:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8feb81e2b000/0xcb7c48919424faa8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424faa1 expref: 21 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.772030:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8feb81e2b000/0xcb7c48919424faa8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424faa1 expref: 21 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.772044:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548889.772071:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+21:3315:x1874380431920256:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548889.772085:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787548889.772098:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787548889.772104:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+20:3316:x1874380431920384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787548889.772111:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548889.772116:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fecbd22f200/0xcb7c48919424f96d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424f966 expref: 20 pid: 14371 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.772123:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fecbd22f200/0xcb7c48919424f96d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424f966 expref: 20 pid: 14371 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.772159:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548889.772186:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+20:3316:x1874380431920384:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548889.772192:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787548889.772203:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787548889.772209:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81810c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:3313:x1874380431920512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787548889.772216:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548889.772220:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f920 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb7c48919424f919 expref: 19 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.772227:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f920 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb7c48919424f919 expref: 19 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548889.772236:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548889.772258:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81810c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:3313:x1874380431920512:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548889.772264:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787548889.772646:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548889.772756:0:16493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec862169c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787548889.772781:0:16493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8feb81e2b000/0xcb7c48919424faa8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424faa1 expref: 18 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548889.772791:0:16493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16493:1874380431919872:0@lo:104: 00010000:00010000:0.0:1787548889.772801:0:16493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecbd22f200/0xcb7c48919424f96d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424f966 expref: 17 pid: 14371 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548889.772809:0:16493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16493:1874380431920000:0@lo:104: 00010000:00010000:0.0:1787548889.772817:0:16493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fecbcc93c00/0xcb7c48919424f920 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb7c48919424f919 expref: 16 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548889.772826:0:16493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a85180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16493:1874380431920128:0@lo:104: 00000100:00100000:1.0:1787548889.774161:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431920256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787548889.774407:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3316:1874380431920384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787548889.775313:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3313:1874380431920512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787548889.780085:0:16493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16493:1874380431919616:192.168.206.13@tcp:104: 00000100:00100000:0.0:1787548889.792880:0:16493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16493:1874380431919744:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548889.792923:0:16493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548889.801102:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548889.801203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548889.801367:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416202880 00000100:00100000:2.0:1787548889.801377:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416202880 00010000:00010000:2.0:1787548889.801412:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8feb82135a00/0xcb7c48919424fbff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2657 expref: 13 pid: 14371 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548889.801448:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416203008 00000100:00100000:2.0:1787548889.801452:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416203008 00010000:00010000:2.0:1787548889.801465:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8feb81e2ac00/0xcb7c48919424fbc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25f5 expref: 14 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548889.801478:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:2.0:1787548889.801500:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3f9a8cf-27da-41c5-bc50-00f0da779636+14:2351:x1874380416202880:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548889.801515:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548889.801521:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8feb82135a00/0xcb7c48919424fbff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2657 expref: 14 pid: 14371 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801537:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8feb82135a00/0xcb7c48919424fbff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2657 expref: 14 pid: 14371 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801554:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8feb82135a00/0xcb7c48919424fbff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2657 expref: 14 pid: 14371 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801569:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548889.801622:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:2351:x1874380416202880:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 124us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548889.801629:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:2.0:1787548889.801647:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 8 00000100:00100000:2.0:1787548889.801653:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3f9a8cf-27da-41c5-bc50-00f0da779636+12:2351:x1874380416203008:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548889.801661:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548889.801666:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8feb81e2ac00/0xcb7c48919424fbc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25f5 expref: 12 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801675:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8feb81e2ac00/0xcb7c48919424fbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25f5 expref: 12 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801684:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8feb81e2ac00/0xcb7c48919424fbc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a25f5 expref: 12 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801693:0:14366:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801706:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801725:0:14366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801732:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801739:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801745:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801751:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150200 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548889.801755:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801762:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801774:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548889.801784:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548889.801807:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3f9a8cf-27da-41c5-bc50-00f0da779636+11:2351:x1874380416203008:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 153us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548889.801813:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 8 00010000:00010000:0.0:1787548889.802005:0:16493:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548889.802014:0:16493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548889.802020:0:16493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc29 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548890.755640:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548891.150662:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431920640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548891.150758:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548891.150876:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431920640 00000100:00100000:2.0:1787548891.150897:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431920640 00000100:00100000:2.0:1787548891.150966:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787548891.150976:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431920640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787548891.151103:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548891.151191:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431920640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 216us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548891.151199:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787548891.151344:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431920640:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787548891.151618:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548891.197538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548891.197610:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548891.197643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548891.197663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548891.197695:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548891.197714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548891.197740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548891.197765:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416203648 00000100:00100000:1.0:1787548891.197774:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416203648 00000100:00100000:1.0:1787548891.197827:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416203264 00000100:00100000:1.0:1787548891.197830:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416203264 00000100:00100000:1.0:1787548891.197874:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 24 00000100:00100000:1.0:1787548891.197885:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:2351:x1874380416203648:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548891.197953:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:2351:x1874380416203648:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 71us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548891.197961:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 24 00000100:00100000:1.0:1787548891.197978:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 25 00000100:00100000:1.0:1787548891.197985:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+6:2351:x1874380416203264:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548891.198020:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+6:2351:x1874380416203264:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548891.198033:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 25 00000100:00100000:1.0:1787548891.198054:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416203392 00000100:00100000:1.0:1787548891.198058:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416203392 00000100:00100000:1.0:1787548891.198076:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416203904 00000100:00100000:1.0:1787548891.198079:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416203904 00000100:00100000:1.0:1787548891.198089:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416203520 00000100:00100000:1.0:1787548891.198092:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416203520 00000100:00100000:1.0:1787548891.198103:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416203776 00000100:00100000:1.0:1787548891.198106:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416203776 00000100:00100000:1.0:1787548891.198118:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:1.0:1787548891.198124:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+5:2351:x1874380416203392:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:1.0:1787548891.198167:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+5:2351:x1874380416203392:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 43us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548891.198287:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:2.0:1787548891.198297:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2351:x1874380416203904:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548891.198325:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2351:x1874380416203904:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 31us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548891.198331:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:2.0:1787548891.198345:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:2.0:1787548891.198351:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+5:2351:x1874380416203520:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548891.198372:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+5:2351:x1874380416203520:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 21us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548891.198378:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:2.0:1787548891.198388:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 13 00000100:00100000:2.0:1787548891.198393:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2351:x1874380416203776:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548891.198415:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2351:x1874380416203776:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 22us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548891.198422:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 13 00000100:00100000:1.0:1787548891.198632:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00080000:1.0:1787548891.198657:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787548891.198661:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787548891.198663:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548891.199468:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416203136 00000100:00100000:3.0:1787548891.199477:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416203136 00000100:00100000:3.0:1787548891.199532:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 107 00000100:00100000:3.0:1787548891.199541:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+11:2351:x1874380416203136:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548891.199590:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+11:2351:x1874380416203136:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 50us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548891.199596:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 107 10000000:01000000:1.0:1787548891.268491:0:14377:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787548891.268499:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fecad2ba000 from 10 10000000:01000000:1.0:1787548891.268504:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787548891.268551:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8feb82135e00/0xcb7c48919424fc30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548891.268563:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8feb82135e00/0xcb7c48919424fc30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548891.268576:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8feb82135e00/0xcb7c48919424fc30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548891.268602:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad561f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431920768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787548891.268679:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548891.268718:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85d053c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787548891.269086:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431920768 00000100:00100000:2.0:1787548891.269094:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431920768 00000100:00100000:2.0:1787548891.269168:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787548891.269186:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+16:14377:x1874380431920768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548891.269198:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548891.269211:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8feb81e2ba00/0xcb7c48919424fc37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424fc30 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548891.269233:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8feb81e2ba00/0xcb7c48919424fc37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424fc30 expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548891.269242:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8feb81e2ba00/0xcb7c48919424fc37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424fc30 expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548891.269253:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2ba00, rc 0) 00000100:00100000:2.0:1787548891.269309:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:14377:x1874380431920768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548891.269316:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787548891.269383:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad561f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431920768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548891.269395:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8feb82135e00/0xcb7c48919424fc30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fc37 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548891.269404:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8feb82135e00/0xcb7c48919424fc30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424fc37 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548891.269452:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431920896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548891.269479:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548891.269494:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865f6180 going to sleep for 11 seconds 00000100:00100000:2.0:1787548891.269507:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431920896 00000100:00100000:2.0:1787548891.269510:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431920896 00000100:00100000:2.0:1787548891.269530:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787548891.269544:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:14377:x1874380431920896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548891.269777:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:14377:x1874380431920896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548891.269784:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787548891.269814:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431920896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548891.269842:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431921024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787548891.269894:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548891.269908:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865f6180 going to sleep for 11 seconds 00000100:00100000:2.0:1787548891.269918:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431921024 00000100:00100000:2.0:1787548891.269921:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431921024 00000100:00100000:2.0:1787548891.269940:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787548891.269945:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:14377:x1874380431921024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787548891.270081:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:14377:x1874380431921024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548891.270088:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787548891.270125:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431921024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787548891.275642:0:16524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787548891.275957:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787548891.275979:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787548891.275990:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8feb82135e00/0xcb7c48919424fc30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fc37 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548891.276003:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8feb82135e00/0xcb7c48919424fc30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fc37 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548891.276012:0:14377:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787548891.276014:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fec88490800 from 10 10000000:01000000:2.0:1787548891.276032:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787548891.276067:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8feb81e2be00/0xcb7c48919424fc3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548891.276076:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8feb81e2be00/0xcb7c48919424fc3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548891.276086:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8feb81e2be00/0xcb7c48919424fc3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548891.276110:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431921152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787548891.276199:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548891.276239:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec840 going to sleep for 11 seconds 00000100:00100000:0.0:1787548891.276296:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431921152 00000100:00100000:0.0:1787548891.276303:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431921152 00000100:00100000:0.0:1787548891.276344:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787548891.276352:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+17:14377:x1874380431921152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787548891.276365:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548891.276378:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424fc3e expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548891.276399:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424fc3e expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548891.276410:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90150200/0xcb7c48919424fc45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424fc3e expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548891.276418:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150200, rc 0) 00000100:00100000:0.0:1787548891.276454:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:14377:x1874380431921152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548891.276469:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787548891.276670:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431921152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548891.276684:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8feb81e2be00/0xcb7c48919424fc3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fc45 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548891.276692:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8feb81e2be00/0xcb7c48919424fc3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424fc45 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548891.276736:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431921280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548891.276756:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548891.276780:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec840 going to sleep for 11 seconds 00000100:00100000:1.0:1787548891.276815:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431921280 00000100:00100000:1.0:1787548891.276819:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431921280 00000100:00100000:1.0:1787548891.276847:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787548891.276854:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:14377:x1874380431921280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787548891.277090:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:14377:x1874380431921280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548891.277097:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787548891.277170:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431921280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548891.277195:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431921408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787548891.277230:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548891.277247:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec840 going to sleep for 11 seconds 00000100:00100000:0.0:1787548891.277344:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431921408 00000100:00100000:0.0:1787548891.277348:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431921408 00000100:00100000:0.0:1787548891.277376:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787548891.277382:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:14377:x1874380431921408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787548891.277505:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:14377:x1874380431921408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548891.277511:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787548891.277654:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431921408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787548891.278657:0:16525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787548891.285296:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787548891.285336:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787548891.285351:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8feb81e2be00/0xcb7c48919424fc3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fc45 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548891.285363:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8feb81e2be00/0xcb7c48919424fc3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fc45 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787548891.285374:0:14377:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787548891.285377:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fecba22b800 from 10 10000000:01000000:2.0:1787548891.285380:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787548891.285416:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.113@tcp lock: ffff8feb81e2ac00/0xcb7c48919424fc4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548891.285423:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.113@tcp lock: ffff8feb81e2ac00/0xcb7c48919424fc4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548891.285434:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.113@tcp lock: ffff8feb81e2ac00/0xcb7c48919424fc4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548891.285457:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431921536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787548891.285517:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548891.285560:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec840 going to sleep for 11 seconds 00000100:00100000:0.0:1787548891.285831:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431921536 00000100:00100000:0.0:1787548891.285839:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431921536 00000100:00100000:0.0:1787548891.285896:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787548891.285907:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+18:14377:x1874380431921536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787548891.285919:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548891.285931:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90150800/0xcb7c48919424fc53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb7c48919424fc4c expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548891.285952:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90150800/0xcb7c48919424fc53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb7c48919424fc4c expref: 19 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548891.285961:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90150800/0xcb7c48919424fc53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb7c48919424fc4c expref: 19 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548891.285970:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150800, rc 0) 00000100:00100000:0.0:1787548891.286010:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:14377:x1874380431921536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548891.286017:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787548891.286342:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431921536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787548891.286358:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.113@tcp lock: ffff8feb81e2ac00/0xcb7c48919424fc4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fc53 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548891.286368:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.113@tcp lock: ffff8feb81e2ac00/0xcb7c48919424fc4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb7c48919424fc53 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548891.286430:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431921664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548891.286458:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548891.286521:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec840 going to sleep for 11 seconds 00000100:00100000:1.0:1787548891.286904:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431921664 00000100:00100000:1.0:1787548891.286909:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431921664 00000100:00100000:1.0:1787548891.286948:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787548891.286955:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:14377:x1874380431921664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787548891.287607:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:14377:x1874380431921664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 650us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548891.287616:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787548891.287715:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431921664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548891.287755:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431921792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787548891.287795:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548891.287825:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8feb826ec840 going to sleep for 11 seconds 00000100:00100000:0.0:1787548891.287923:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431921792 00000100:00100000:0.0:1787548891.287928:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431921792 00000100:00100000:0.0:1787548891.287956:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787548891.287964:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:14377:x1874380431921792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787548891.288116:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:14377:x1874380431921792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548891.288123:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787548891.288223:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:14377:1874380431921792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787548891.289093:0:16526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787548891.295654:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787548891.295692:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787548891.295704:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.113@tcp lock: ffff8feb81e2ac00/0xcb7c48919424fc4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fc53 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548891.295716:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.113@tcp lock: ffff8feb81e2ac00/0xcb7c48919424fc4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb7c48919424fc53 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548891.319605:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548891.319700:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416204032 00000100:00100000:0.0:1787548891.319710:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416204032 00000100:00100000:0.0:1787548891.319763:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 117 00000100:00100000:0.0:1787548891.319773:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb42aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+11:13758:x1874380416204032:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787548891.319789:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548891.319804:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fec90150000/0xcb7c48919424fc5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2688 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548891.319829:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fec90150000/0xcb7c48919424fc5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2688 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548891.319839:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fec90150000/0xcb7c48919424fc5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2688 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548891.319847:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150000, rc 0) 00000100:00100000:0.0:1787548891.319910:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb42aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+12:13758:x1874380416204032:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 Request processed in 138us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548891.319917:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 117 00000100:00100000:2.0:1787548891.327945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548891.328028:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416204160 00000100:00100000:1.0:1787548891.328037:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416204160 00000100:00100000:1.0:1787548891.328091:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 118 00000100:00100000:1.0:1787548891.328100:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+12:13758:x1874380416204160:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787548891.328644:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+12:13758:x1874380416204160:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 Request processed in 543us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548891.328654:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 118 00000100:00100000:1.0:1787548891.343823:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548891.343980:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416204288 00000100:00100000:0.0:1787548891.343991:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416204288 00000100:00100000:0.0:1787548891.344055:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 119 00000100:00100000:0.0:1787548891.344074:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+12:13758:x1874380416204288:12345-192.168.206.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787548891.344309:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+12:13758:x1874380416204288:12345-192.168.206.13@tcp:503:ll_cfg_requeue.0 Request processed in 237us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548891.344318:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 119 00000100:00100000:2.0:1787548891.357049:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548891.360240:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416204416 00000100:00100000:3.0:1787548891.360266:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416204416 00000100:00100000:3.0:1787548891.360334:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 120 00000100:00100000:3.0:1787548891.360344:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+12:13758:x1874380416204416:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787548891.360363:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548891.360381:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fecbcc93800/0xcb7c48919424fc61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a268f expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548891.360408:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fecbcc93800/0xcb7c48919424fc61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a268f expref: 13 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548891.360420:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fecbcc93800/0xcb7c48919424fc61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a268f expref: 13 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548891.360430:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc93800, rc 0) 00000100:00100000:3.0:1787548891.360487:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:13758:x1874380416204416:12345-192.168.206.13@tcp:101:ll_cfg_requeue.0 Request processed in 144us (3449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548891.360500:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 120 00000100:00100000:3.0:1787548891.365208:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548891.365522:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416204544 00000100:00100000:2.0:1787548891.365531:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416204544 00000100:00100000:2.0:1787548891.365586:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 121 00000100:00100000:2.0:1787548891.365596:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:13758:x1874380416204544:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787548891.365884:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:13758:x1874380416204544:12345-192.168.206.13@tcp:501:ll_cfg_requeue.0 Request processed in 288us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548891.365902:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 121 00000100:00100000:1.0:1787548891.374507:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548891.374581:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416204672 00000100:00100000:0.0:1787548891.374591:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416204672 00000100:00100000:0.0:1787548891.374652:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 122 00000100:00100000:0.0:1787548891.374922:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:13758:x1874380416204672:12345-192.168.206.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787548891.375270:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:13758:x1874380416204672:12345-192.168.206.13@tcp:503:ll_cfg_requeue.0 Request processed in 351us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548891.375279:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 122 00010000:00010000:2.0:1787548891.783693:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787548892.675379:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787548892.675402:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431921920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787548892.675465:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548892.675590:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431921920 00000100:00100000:0.0:1787548892.675598:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431921920 00000100:00100000:3.0:1787548892.675842:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431922304:0@lo:400:kworker.0 00000100:00100000:3.0:1787548892.675890:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548892.675920:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787548892.675926:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431922176:0@lo:400:kworker.0 00000100:00100000:3.0:1787548892.675950:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548892.679147:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787548892.679168:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431921920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787548892.679207:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787548892.679281:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431921920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (3815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548892.679288:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787548892.679385:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787548892.679415:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431922304 00000100:00100000:1.0:1787548892.679423:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431922304 00000100:00100000:1.0:1787548892.679471:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787548892.679479:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431922304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548892.679532:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874380431922304:12345-0@lo:400:kworker.0 Request processed in 54us (3642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548892.679539:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787548892.679587:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874380431922304:0@lo:400:kworker.0 00000100:00100000:0.0:1787548892.680772:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431922432:0@lo:400:kworker.0 00000100:00100000:0.0:1787548892.680876:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548892.680918:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787548892.680925:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431922048:0@lo:400:kworker.0 00000100:00100000:0.0:1787548892.680953:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548892.680987:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecad57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431922560:0@lo:400:kworker.0 00000100:00100000:0.0:1787548892.681778:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548892.681813:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431922048 00000100:00100000:0.0:1787548892.681820:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431922048 00000100:00100000:0.0:1787548892.681871:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787548892.681880:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:3315:x1874380431922048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548892.681941:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:3315:x1874380431922048:12345-0@lo:400:kworker.0 Request processed in 62us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548892.681948:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787548892.681997:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431922048:0@lo:400:kworker.0 00000100:00100000:0.0:1787548892.682181:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431922176 00000100:00100000:0.0:1787548892.682185:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431922176 00000100:00100000:0.0:1787548892.682218:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787548892.682225:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431922176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548892.682331:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431922176:12345-0@lo:400:kworker.0 Request processed in 106us (6379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548892.682338:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787548892.682378:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431921920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787548892.682455:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431922432 00000100:00100000:1.0:1787548892.682460:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431922432 00000100:00100000:1.0:1787548892.682504:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431922560 00000100:00100000:1.0:1787548892.682507:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431922560 00000100:00100000:1.0:1787548892.682528:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787548892.682535:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431922432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548892.682575:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874380431922432:12345-0@lo:400:kworker.0 Request processed in 41us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548892.682594:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787548892.682607:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787548892.682612:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431922560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548892.682639:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431922560:12345-0@lo:400:kworker.0 Request processed in 27us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548892.682645:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787548892.682682:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431922176:0@lo:400:kworker.0 00000100:00100000:1.0:1787548892.682713:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431922560:0@lo:400:kworker.0 00000100:00100000:1.0:1787548892.682738:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecad57e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874380431922432:0@lo:400:kworker.0 00000100:00080000:0.0:1787548892.686552:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787548892.804268:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548893.828382:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548894.560904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548894.561732:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416204800 00000100:00100000:1.0:1787548894.561743:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416204800 00000100:00100000:1.0:1787548894.561819:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 15 00000100:00100000:1.0:1787548894.561829:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+6:14412:x1874380416204800:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787548894.561858:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548894.561891:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fc68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2696 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.561958:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.561972:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.561985:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.561997:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.562286:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.562295:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787548894.564169:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787548894.567284:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135200/0xcb7c48919424fc7d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.569941:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135200/0xcb7c48919424fc7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.569956:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135200/0xcb7c48919424fc7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548894.570193:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787548894.570198:0:14381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787548894.570304:0:14381:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135200/0xcb7c48919424fc7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570319:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570325:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570332:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570338:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82134400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548894.570343:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570349:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570362:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:1.0:1787548894.570365:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548894.570368:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570385:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570398:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570404:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570409:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570414:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82135000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548894.570417:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570423:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570431:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8fec838f6500) 00010000:00010000:1.0:1787548894.570433:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548894.570436:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570442:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570485:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fc68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2696 expref: 8 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570513:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135200/0xcb7c48919424fc7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2696 expref: 7 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.570520:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fec838f6d00) 00010000:00010000:1.0:1787548894.570522:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787548894.570525:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb82135200, rc 0) 00000100:00100000:1.0:1787548894.570606:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+7:14412:x1874380416204800:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 8778us (9711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548894.570616:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 15 00000100:00100000:3.0:1787548894.578768:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548894.578946:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416205056 00000100:00100000:1.0:1787548894.578969:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416205056 00000100:00100000:1.0:1787548894.579044:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:1.0:1787548894.579054:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+7:14412:x1874380416205056:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787548894.579073:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548894.579093:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fc84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a269d expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.579218:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc8b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.579231:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.579242:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.579295:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.579317:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.579325:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.579851:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134a00/0xcb7c48919424fc99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.579863:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134a00/0xcb7c48919424fc99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.579871:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134a00/0xcb7c48919424fc99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548894.579880:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787548894.580162:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580170:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc8b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580178:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580185:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82135000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548894.580190:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580197:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc8b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580219:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fec838f6d00) 00010000:00010000:1.0:1787548894.580222:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548894.580227:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580234:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fc8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580246:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580251:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc92 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580257:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580263:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82134400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548894.580265:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580271:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc92 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580278:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8fec838f6500) 00010000:00010000:1.0:1787548894.580281:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548894.580284:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc92 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580289:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fc92 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580708:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fc84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a269d expref: 10 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580724:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134a00/0xcb7c48919424fc99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a269d expref: 9 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.580731:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fec838f6900) 00010000:00010000:1.0:1787548894.580733:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548894.580735:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb82134a00, rc 0) 00000100:00100000:1.0:1787548894.580794:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+9:14412:x1874380416205056:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 1741us (2034us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787548894.580802:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:2.0:1787548894.588467:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548894.588587:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416205184 00000100:00100000:1.0:1787548894.588597:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416205184 00000100:00100000:1.0:1787548894.588666:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 17 00000100:00100000:1.0:1787548894.588677:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+9:14412:x1874380416205184:12345-192.168.206.13@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787548894.588783:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+9:14412:x1874380416205184:12345-192.168.206.13@tcp:59:lhsmtool_posix.0 Request processed in 107us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548894.588791:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 17 00000100:00100000:0.0:1787548894.652258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548894.652416:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416205312 00000100:00100000:1.0:1787548894.652428:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416205312 00000100:00100000:1.0:1787548894.652510:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00100000:1.0:1787548894.652523:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+9:14418:x1874380416205312:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:1.0:1787548894.652551:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548894.652576:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fca7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a26a4 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.652677:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.652694:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.652708:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.652723:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fcb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655195:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fcb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655215:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fcb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655562:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655572:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655581:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655587:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82134400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548894.655592:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655614:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655631:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:1.0:1787548894.655635:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548894.655641:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655648:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655665:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fcb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655671:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fcb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655678:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fcb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655683:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82135000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548894.655686:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fcb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655692:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fcb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655701:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fec838f6500) 00010000:00010000:1.0:1787548894.655703:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548894.655707:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fcb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.655723:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fcb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.657338:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fca7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26a4 expref: 10 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.657362:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:1.0:1787548894.657365:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548894.657371:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fca7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26a4 expref: 10 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.657384:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb82135c00, rc 0) 00000100:00100000:1.0:1787548894.657497:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+9:14418:x1874380416205312:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 4975us (5373us total) trans 0 rc 301/301 00000100:00100000:1.0:1787548894.657508:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00100000:3.0:1787548894.666056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548894.667561:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416205440 00000100:00100000:1.0:1787548894.667580:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416205440 00000100:00100000:1.0:1787548894.667645:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 0 00000100:00100000:1.0:1787548894.667657:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:555100d0-5cca-42dc-9b2b-8251df4fed16+9:14418:x1874380416205440:12345-192.168.206.13@tcp:700:lfs.0 00000100:00100000:1.0:1787548894.668522:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:555100d0-5cca-42dc-9b2b-8251df4fed16+9:14418:x1874380416205440:12345-192.168.206.13@tcp:700:lfs.0 Request processed in 859us (2473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548894.668532:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 0 00000100:00100000:3.0:1787548894.684487:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548894.686878:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416205696 00000100:00100000:2.0:1787548894.686910:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416205696 00000100:00100000:2.0:1787548894.687016:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 19 00000100:00100000:2.0:1787548894.687028:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+9:14418:x1874380416205696:12345-192.168.206.13@tcp:36:lfs.0 00010000:00010000:2.0:1787548894.687107:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548894.687189:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fbea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a261f expref: 9 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.687214:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:2.0:1787548894.687221:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787548894.687565:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.687583:0:14381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424fc22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2681 expref: 5 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.687592:0:14381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.687636:0:14381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424fc22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2681 expref: 5 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.687666:0:14381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424fc22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2681 expref: 5 pid: 14380 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548894.687685:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14381:1874380431922688:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548894.688233:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787548894.699554:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14381:1874380431922688:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548894.699591:0:14381:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548894.702343:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548894.702481:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416205824 00000100:00100000:2.0:1787548894.702494:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416205824 00010000:00010000:2.0:1787548894.702611:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424fc22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2681 expref: 6 pid: 14380 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548894.702665:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00100000:2.0:1787548894.702676:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:2352:x1874380416205824:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548894.702695:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548894.702703:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424fc22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2681 expref: 6 pid: 14380 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.702719:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424fc22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2681 expref: 6 pid: 14380 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.702757:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92e00/0xcb7c48919424fc22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2681 expref: 6 pid: 14380 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.702800:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:2.0:1787548894.702806:0:14366:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.702818:0:14366:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.702826:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.702873:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548894.702955:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2352:x1874380416205824:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 281us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548894.702965:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 9 00010000:00010000:1.0:1787548894.703109:0:14381:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.703118:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.703183:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fcc3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.703195:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fcc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.703203:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fcc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787548894.703581:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1787548894.710220:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787548894.710251:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.710265:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.710273:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.710281:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2a000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548894.710286:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.710296:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.710319:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8feca2cf6b00) 00010000:00010000:1.0:1787548894.710322:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548894.710328:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.710349:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fcbc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787548894.710380:0:14381:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f15bd40 reply state 000000009652c8d1 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fcc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548894.710392:0:14381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787548894.710520:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+10:14418:x1874380416205696:12345-192.168.206.13@tcp:36:lfs.0 Request processed in 23488us (26041us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787548894.710531:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 19 00010000:00010000:2.0:1787548894.714749:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fcc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.714773:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fcc3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.714784:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fcc3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.714792:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82135c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548894.714798:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fcc3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.714807:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fcc3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.714857:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fec838f6500) 00010000:00010000:2.0:1787548894.714861:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548894.714867:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fcc3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.714874:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135c00/0xcb7c48919424fcc3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548894.831694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548894.832183:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416205952 00000100:00100000:1.0:1787548894.832197:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416205952 00000100:00100000:1.0:1787548894.832284:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00100000:1.0:1787548894.832300:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+9:14426:x1874380416205952:12345-192.168.206.13@tcp:101:lctl.0 00010000:00010000:1.0:1787548894.832337:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548894.832371:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fcca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a26ab expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.832462:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcd1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.832490:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.832506:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548894.832597:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787548894.832602:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787548894.832683:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.832715:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fcca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ab expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.832738:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134400/0xcb7c48919424fcd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ab expref: 10 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.832750:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec838f6700) 00010000:00010000:1.0:1787548894.832753:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787548894.832758:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb82134400, rc 0) 00000100:00100000:1.0:1787548894.832862:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+10:14426:x1874380416205952:12345-192.168.206.13@tcp:101:lctl.0 Request processed in 565us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548894.832870:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 20 00010000:00010000:1.0:1787548894.852590:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548894.857827:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548894.858007:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416206080 00000100:00100000:1.0:1787548894.858020:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416206080 00000100:00100000:1.0:1787548894.858099:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 21 00000100:00100000:1.0:1787548894.858110:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:14427:x1874380416206080:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:1.0:1787548894.858187:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548894.858212:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fcd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a26b2 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.858298:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135a00/0xcb7c48919424fcdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.858314:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135a00/0xcb7c48919424fcdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.858349:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135a00/0xcb7c48919424fcdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548894.858425:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787548894.858428:0:14380:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787548894.858457:0:14380:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135a00/0xcb7c48919424fcdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.858486:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fcd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26b2 expref: 7 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.858508:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135a00/0xcb7c48919424fcdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26b2 expref: 6 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.858516:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec838f6700) 00010000:00010000:1.0:1787548894.858520:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787548894.858524:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb82135a00, rc 0) 00000100:00100000:1.0:1787548894.858603:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:14427:x1874380416206080:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 494us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548894.858612:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 21 00000100:00100000:0.0:1787548894.861545:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548894.862983:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416206208 00000100:00100000:1.0:1787548894.863020:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416206208 00000100:00100000:2.0:1787548894.863345:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 22 00000100:00100000:2.0:1787548894.863366:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:14427:x1874380416206208:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548894.863394:0:15793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548894.863432:0:15793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fce6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a26b9 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.863536:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fced lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.863564:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fced lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.863585:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fced lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.863614:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fcf4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.863624:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.863637:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.866600:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fcfb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.866733:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fcfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.866748:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fcfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548894.866825:0:15793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787548894.866829:0:15793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548894.866876:0:15793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fcfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.866892:0:15793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fced lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.866899:0:15793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fced lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.866906:0:15793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fced lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.866912:0:15793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2ae00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548894.866916:0:15793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fced lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.866924:0:15793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fced lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.866936:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec838f6700) 00010000:00010000:2.0:1787548894.866952:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548894.866959:0:15793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fced lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.866965:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fced lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.866986:0:15793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.866992:0:15793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fcf4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.866998:0:15793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fcf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.867003:0:15793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2b400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548894.867006:0:15793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fcf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.867012:0:15793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fcf4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.867020:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fec87ceb700) 00010000:00010000:2.0:1787548894.867022:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548894.867025:0:15793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fcf4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.867030:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fcf4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.867072:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fce6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26b9 expref: 8 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.867112:0:15793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fcfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26b9 expref: 7 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548894.867120:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fec87cebe00) 00010000:00010000:2.0:1787548894.867123:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787548894.867126:0:15793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2a600, rc 0) 00000100:00100000:2.0:1787548894.867486:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+7:14427:x1874380416206208:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 4127us (5957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548894.867495:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 22 00000100:00100000:3.0:1787548894.876611:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548894.876731:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416206464 00000100:00100000:1.0:1787548894.876745:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416206464 00000100:00100000:1.0:1787548894.876824:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 23 00000100:00100000:1.0:1787548894.876836:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+7:14427:x1874380416206464:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:1.0:1787548894.876873:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548894.876898:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fd02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a26c0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548894.881034:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787548894.881282:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fd02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26c0 expref: 9 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.881327:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec838f6700) 00010000:00010000:0.0:1787548894.881330:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787548894.881336:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135000/0xcb7c48919424fd02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26c0 expref: 9 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.881355:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb82135000, rc 0) 00000100:00100000:0.0:1787548894.881475:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+8:14427:x1874380416206464:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 4640us (4875us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787548894.881487:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 23 00000100:00100000:3.0:1787548894.886688:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548894.886868:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416206720 00000100:00100000:1.0:1787548894.886883:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416206720 00000100:00100000:1.0:1787548894.886967:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 24 00000100:00100000:1.0:1787548894.886979:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+8:14427:x1874380416206720:12345-192.168.206.13@tcp:36:lfs.0 00010000:00010000:1.0:1787548894.887065:0:14379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548894.887101:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fcfb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26b9 expref: 8 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.887401:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fec87cebe00) 00010000:00010000:1.0:1787548894.887426:0:14379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787548894.887464:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424fd10 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.887552:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424fd10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.887566:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424fd10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787548894.888430:0:14379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000607c7ae6 reply state 00000000329fce0f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424fd10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548894.888445:0:14379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787548894.888464:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787548894.889036:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+9:14427:x1874380416206720:12345-192.168.206.13@tcp:36:lfs.0 Request processed in 2050us (2353us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787548894.889048:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 24 00000100:00100000:1.0:1787548894.893981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00010000:00010000:3.0:1787548894.894203:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424fd10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548894.894230:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424fd10 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548894.894239:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424fd10 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548894.894246:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82134800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548894.894253:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424fd10 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548894.894274:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424fd10 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548894.894297:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fec838f6800) 00010000:00010000:3.0:1787548894.894300:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787548894.894306:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424fd10 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548894.894312:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424fd10 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548894.894598:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416206976 00000100:00100000:2.0:1787548894.894613:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416206976 00000100:00100000:2.0:1787548894.894689:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 2 00000100:00100000:2.0:1787548894.894702:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+8:14427:x1874380416206976:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:2.0:1787548894.895524:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+9:14427:x1874380416206976:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 815us (1549us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787548894.895539:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 2 00000100:00100000:0.0:1787548894.900797:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548894.902198:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416207232 00000100:00100000:1.0:1787548894.902215:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416207232 00000100:00100000:1.0:1787548894.902293:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 25 00000100:00100000:1.0:1787548894.902307:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+9:14427:x1874380416207232:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:1.0:1787548894.902337:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548894.902362:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134e00/0xcb7c48919424fd17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a26c7 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.902454:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134200/0xcb7c48919424fd1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.902472:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134200/0xcb7c48919424fd1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.902497:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134200/0xcb7c48919424fd1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.902513:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424fd25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.902521:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424fd25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548894.902528:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424fd25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548894.903092:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787548894.903259:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134200/0xcb7c48919424fd1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903270:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134200/0xcb7c48919424fd1e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903279:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134200/0xcb7c48919424fd1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903286:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82134200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548894.903291:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134200/0xcb7c48919424fd1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903300:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134200/0xcb7c48919424fd1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903316:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec838f6700) 00010000:00010000:0.0:1787548894.903336:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548894.903342:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134200/0xcb7c48919424fd1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903349:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134200/0xcb7c48919424fd1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903366:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424fd25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903372:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424fd25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903379:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424fd25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903384:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82134c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548894.903388:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424fd25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903395:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424fd25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903403:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fec838f6300) 00010000:00010000:0.0:1787548894.903405:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548894.903408:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424fd25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903414:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424fd25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903463:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134e00/0xcb7c48919424fd17 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26c7 expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903492:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec838f6700) 00010000:00010000:0.0:1787548894.903495:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787548894.903499:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134e00/0xcb7c48919424fd17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26c7 expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.903510:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb82134e00, rc 0) 00000100:00100000:0.0:1787548894.903611:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+10:14427:x1874380416207232:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 1306us (2827us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787548894.903621:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 25 00000100:00100000:3.0:1787548894.907189:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548894.911700:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416207360 00000100:00100000:0.0:1787548894.911724:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416207360 00000100:00100000:0.0:1787548894.911826:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 26 00000100:00100000:0.0:1787548894.911851:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+10:14427:x1874380416207360:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548894.911884:0:15793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548894.911927:0:15793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fd33 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a26ce expref: -99 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.912034:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fd3a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.912049:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fd3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.912062:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fd3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548894.912162:0:15793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787548894.912185:0:15793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548894.912217:0:15793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fd3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.912247:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fd33 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ce expref: 12 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.912265:0:15793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fd3a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ce expref: 11 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548894.912274:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:0.0:1787548894.912276:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787548894.912279:0:15793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151c00, rc 0) 00000100:00100000:0.0:1787548894.912371:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+11:14427:x1874380416207360:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 534us (5242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548894.912378:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 26 00000100:00100000:1.0:1787548894.918568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548894.918859:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416207488 00000100:00100000:3.0:1787548894.918873:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416207488 00000100:00100000:3.0:1787548894.918954:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 3 00000100:00100000:3.0:1787548894.918968:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+11:14427:x1874380416207488:12345-192.168.206.13@tcp:37:lfs.0 00000100:00100000:0.0:1787548894.926715:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+11:14427:x1874380416207488:12345-192.168.206.13@tcp:37:lfs.0 Request processed in 7734us (8146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548894.927083:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 3 00000100:00100000:2.0:1787548894.935297:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548894.935529:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416207744 00000100:00100000:3.0:1787548894.935542:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416207744 00000100:00100000:3.0:1787548894.935613:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 4 00000100:00100000:3.0:1787548894.935625:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7e09050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+11:14427:x1874380416207744:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:3.0:1787548894.937374:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7e09050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+12:14427:x1874380416207744:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 1738us (2078us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787548894.937390:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 4 00000100:00100000:1.0:1787548895.025785:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548895.026701:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416207872 00000100:00100000:2.0:1787548895.026717:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416207872 00000100:00100000:2.0:1787548895.026807:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 27 00000100:00100000:2.0:1787548895.026819:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+10:14433:x1874380416207872:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:2.0:1787548895.026855:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548895.026882:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a26d5 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.026992:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fd48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027009:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fd48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027023:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fd48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027039:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027046:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027053:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027255:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b000/0xcb7c48919424fd56 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027264:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b000/0xcb7c48919424fd56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027270:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b000/0xcb7c48919424fd56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548895.027304:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787548895.027307:0:14381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548895.027354:0:14381:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b000/0xcb7c48919424fd56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027379:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fd48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027385:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fd48 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027392:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fd48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027398:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2ae00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548895.027403:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fd48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027410:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fd48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027424:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec838f6700) 00010000:00010000:2.0:1787548895.027427:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548895.027433:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fd48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027439:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fd48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027458:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027464:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027470:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027481:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2a400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548895.027485:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027491:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027500:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fec87ceb700) 00010000:00010000:2.0:1787548895.027502:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548895.027505:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027510:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027548:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26d5 expref: 12 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027563:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b000/0xcb7c48919424fd56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26d5 expref: 11 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.027570:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:2.0:1787548895.027573:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787548895.027575:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2b000, rc 0) 00000100:00100000:2.0:1787548895.027672:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+11:14433:x1874380416207872:12345-192.168.206.13@tcp:101:bash.0 Request processed in 854us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548895.027680:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 27 00000100:00100000:0.0:1787548895.030730:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548895.031333:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416208128 00000100:00100000:2.0:1787548895.031366:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416208128 00000100:00100000:2.0:1787548895.031503:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 28 00000100:00100000:2.0:1787548895.031517:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+11:14433:x1874380416208128:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:2.0:1787548895.031545:0:15793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548895.031571:0:15793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fd5d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a26dc expref: -99 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.031738:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.031757:0:15793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fd3a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ce expref: 11 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.031766:0:15793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.031811:0:15793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fd3a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ce expref: 11 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.031826:0:15793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fd3a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ce expref: 11 pid: 15793 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548895.031853:0:15793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15793:1874380431922816:192.168.206.13@tcp:104: 00000100:00100000:2.0:1787548895.031972:0:15793:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb4300 going to sleep for 11 seconds 00000100:00100000:2.0:1787548895.040482:0:15793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15793:1874380431922816:192.168.206.13@tcp:104: 00010000:00010000:2.0:1787548895.040528:0:15793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548895.048728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548895.049087:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416208256 00000100:00100000:3.0:1787548895.049102:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416208256 00010000:00010000:3.0:1787548895.049213:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fd3a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ce expref: 12 pid: 15793 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548895.049290:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:3.0:1787548895.049302:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+12:2352:x1874380416208256:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548895.049322:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548895.049332:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fd3a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ce expref: 12 pid: 15793 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.049347:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fd3a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ce expref: 12 pid: 15793 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.049375:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fd3a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ce expref: 12 pid: 15793 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.049398:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:3.0:1787548895.049403:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.049414:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.049423:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.049461:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548895.049528:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+11:2352:x1874380416208256:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 227us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548895.049536:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 10 00010000:00010000:2.0:1787548895.049714:0:15793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.049723:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.049765:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd6b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.049776:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.049785:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.054583:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd72 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.054612:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.054627:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548895.054642:0:15793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787548895.054680:0:15793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.054688:0:15793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.054696:0:15793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.054718:0:15793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2a200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548895.054724:0:15793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.054731:0:15793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.054761:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:2.0:1787548895.054765:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548895.054771:0:15793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.054777:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd64 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787548895.054797:0:15793:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065c6f516 reply state 00000000d2ef696a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548895.054807:0:15793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787548895.054866:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fd5d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26dc expref: 14 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.054883:0:15793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26dc expref: 13 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.054891:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548895.054894:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787548895.054896:0:15793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2a400, rc 0) 00000100:00100000:2.0:1787548895.057781:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+14:14433:x1874380416208128:12345-192.168.206.13@tcp:101:bash.0 Request processed in 23478us (24276us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787548895.057823:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 28 00010000:00010000:2.0:1787548895.061392:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.061416:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd6b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.061425:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.061431:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2b400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548895.061437:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.061446:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd6b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.061469:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8fec87ceb700) 00010000:00010000:2.0:1787548895.061473:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548895.061478:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd6b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.061485:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd6b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548895.084944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548895.085198:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416208384 00000100:00100000:2.0:1787548895.085212:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416208384 00000100:00100000:2.0:1787548895.085287:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 29 00000100:00100000:2.0:1787548895.085299:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+13:14433:x1874380416208384:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:2.0:1787548895.085331:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548895.085373:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd80 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a26e3 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.085472:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fd87 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.085488:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fd87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.085501:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fd87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548895.085564:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787548895.085569:0:14381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548895.085593:0:14381:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fd87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.085606:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fd87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.085635:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fd80 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26e3 expref: 15 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.085660:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fd87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26e3 expref: 14 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.085669:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548895.085672:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548895.085676:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2b200, rc 0) 00000100:00100000:2.0:1787548895.085755:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+14:14433:x1874380416208384:12345-192.168.206.13@tcp:101:bash.0 Request processed in 457us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548895.085773:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 29 00000100:00100000:0.0:1787548895.090219:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548895.090459:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416208640 00000100:00100000:3.0:1787548895.090493:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416208640 00000100:00100000:3.0:1787548895.090569:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 5 00000100:00100000:3.0:1787548895.090581:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+14:14433:x1874380416208640:12345-192.168.206.13@tcp:35:bash.0 00000100:00100000:3.0:1787548895.091104:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+15:14433:x1874380416208640:12345-192.168.206.13@tcp:35:bash.0 Request processed in 522us (896us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787548895.091114:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 5 00000100:00100000:2.0:1787548895.256877:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548895.256978:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416208896 00000100:00100000:1.0:1787548895.256994:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416208896 00000100:00100000:1.0:1787548895.257097:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 30 00000100:00100000:1.0:1787548895.257171:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+15:14443:x1874380416208896:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:1.0:1787548895.257208:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787548895.257237:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135800/0xcb7c48919424fd8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a26ea expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787548895.257400:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787548895.258018:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135800/0xcb7c48919424fd8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ea expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548895.258880:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec838f6700) 00010000:00010000:1.0:1787548895.258884:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787548895.258895:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135800/0xcb7c48919424fd8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ea expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548895.258916:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb82135800, rc 0) 00000100:00100000:1.0:1787548895.261076:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+16:14443:x1874380416208896:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 1898us (2160us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787548895.261097:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 30 00000100:00100000:0.0:1787548895.266683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548895.266780:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416209152 00000100:00100000:3.0:1787548895.266792:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416209152 00000100:00100000:3.0:1787548895.266878:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 6 00000100:00100000:3.0:1787548895.266890:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+16:14443:x1874380416209152:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:3.0:1787548895.269369:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+17:14443:x1874380416209152:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 2463us (2681us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787548895.269386:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 6 00000100:00100000:0.0:1787548895.326442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548895.329655:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416209408 00000100:00100000:2.0:1787548895.329670:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416209408 00000100:00100000:2.0:1787548895.330224:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 31 00000100:00100000:2.0:1787548895.330264:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+17:14446:x1874380416209408:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548895.330293:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548895.330325:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd9c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a26f1 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.330490:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fda3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.330515:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fda3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.330531:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fda3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548895.330544:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787548895.330690:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fd9c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26f1 expref: 20 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.330712:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fda3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26f1 expref: 19 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.330720:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548895.330723:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548895.330740:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2ae00, rc 0) 00000100:00100000:2.0:1787548895.330817:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+19:14446:x1874380416209408:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 583us (4387us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787548895.330824:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 31 00000100:00100000:3.0:1787548895.339619:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548895.339658:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548895.340882:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416209536 00000100:00100000:0.0:1787548895.340896:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416209536 00000100:00100000:0.0:1787548895.340974:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 32 00000100:00100000:0.0:1787548895.340986:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+19:14446:x1874380416209536:12345-192.168.206.13@tcp:54:lfs.0 00010000:00010000:0.0:1787548895.341067:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fdb1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548895.341082:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548895.341093:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548895.341120:0:15793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548895.341128:0:15793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fdb1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548895.341163:0:15793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fdb1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548895.341170:0:15793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548895.341175:0:15793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fdb1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548895.341183:0:15793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fdb1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548895.341194:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:0.0:1787548895.341197:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787548895.341201:0:15793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fdb1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548895.341208:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fdb1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548895.341294:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+19:14446:x1874380416209536:12345-192.168.206.13@tcp:54:lfs.0 Request processed in 310us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548895.341302:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 32 00000100:00100000:1.0:1787548895.342673:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416209664 00000100:00100000:1.0:1787548895.342686:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416209664 00000100:00100000:1.0:1787548895.342786:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 0 00000100:00100000:1.0:1787548895.342797:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+19:2354:x1874380416209664:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548895.342810:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548895.342830:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fda3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26f1 expref: 19 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548895.342862:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:1.0:1787548895.342878:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548895.342941:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+18:2354:x1874380416209664:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 146us (3283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548895.342949:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 0 00000100:00100000:0.0:1787548895.348860:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548895.349031:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416209920 00000100:00100000:3.0:1787548895.349049:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416209920 00000100:00100000:3.0:1787548895.349171:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 7 00000100:00100000:3.0:1787548895.349184:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+18:14446:x1874380416209920:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:3.0:1787548895.352833:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+19:14446:x1874380416209920:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 3642us (3971us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787548895.352857:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 7 00000040:00080000:2.0:1787548895.429336:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787548895.667806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548895.667927:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416210176 00000100:00100000:0.0:1787548895.667938:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416210176 00000100:00100000:0.0:1787548895.668007:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 33 00000100:00100000:0.0:1787548895.668017:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+19:14477:x1874380416210176:12345-192.168.206.13@tcp:101:cat.0 00010000:00010000:0.0:1787548895.668039:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548895.668059:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fdb8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a26f8 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548895.669526:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fdbf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548895.669548:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fdbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548895.669560:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fdbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548895.669571:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787548895.669725:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fdb8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26f8 expref: 22 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548895.669747:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fdbf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26f8 expref: 21 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548895.669776:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:0.0:1787548895.669779:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548895.669783:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151600, rc 0) 00000100:00100000:0.0:1787548895.669879:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+21:14477:x1874380416210176:12345-192.168.206.13@tcp:101:cat.0 Request processed in 1861us (2080us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787548895.669889:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 33 00000100:00100000:0.0:1787548895.687256:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548895.687302:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548895.687442:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416210560 00000100:00100000:1.0:1787548895.687452:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416210560 00000100:00100000:1.0:1787548895.687508:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 8 00000100:00100000:1.0:1787548895.687518:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+21:14477:x1874380416210560:12345-192.168.206.13@tcp:35:cat.0 00000100:00100000:1.0:1787548895.687882:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+22:14477:x1874380416210560:12345-192.168.206.13@tcp:35:cat.0 Request processed in 364us (577us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787548895.687889:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 8 00000100:00100000:3.0:1787548895.688729:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416210304 00000100:00100000:3.0:1787548895.688738:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416210304 00000100:00100000:3.0:1787548895.688791:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 1 00000100:00100000:3.0:1787548895.688801:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+22:2352:x1874380416210304:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787548895.688828:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787548895.688861:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fdbf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26f8 expref: 22 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.688879:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:3.0:1787548895.688883:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548895.688925:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+21:2352:x1874380416210304:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 127us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548895.688932:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 1 00000100:00100000:0.0:1787548895.799385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548895.800202:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416210816 00000100:00100000:3.0:1787548895.800216:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416210816 00000100:00100000:3.0:1787548895.800697:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 34 00000100:00100000:3.0:1787548895.800712:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+21:14483:x1874380416210816:12345-192.168.206.13@tcp:101:dd.0 00010000:00010000:3.0:1787548895.800857:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548895.800887:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424fdcd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a26ff expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.801037:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92200/0xcb7c48919424fdd4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.801055:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92200/0xcb7c48919424fdd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.801070:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92200/0xcb7c48919424fdd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787548895.801082:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787548895.803823:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92800/0xcb7c48919424fdcd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ff expref: 24 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.803893:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92200/0xcb7c48919424fdd4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ff expref: 23 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.803905:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:3.0:1787548895.803909:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787548895.803913:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92200, rc 0) 00000100:00100000:3.0:1787548895.804019:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+23:14483:x1874380416210816:12345-192.168.206.13@tcp:101:dd.0 Request processed in 3309us (4648us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787548895.804029:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 34 00000100:00100000:0.0:1787548895.814672:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548895.814929:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416211072 00000100:00100000:2.0:1787548895.814941:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416211072 00000100:00100000:2.0:1787548895.815028:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 35 00000100:00100000:2.0:1787548895.815040:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+23:14483:x1874380416211072:12345-192.168.206.13@tcp:36:dd.0 00010000:00010000:2.0:1787548895.815118:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787548895.815202:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fecbcc92200/0xcb7c48919424fdd4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26ff expref: 23 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.815234:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fd87 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26e3 expref: 22 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.815251:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548895.815258:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787548895.815979:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fde2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.816019:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fde2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.816032:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fde2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787548895.816108:0:14380:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787548895.817898:0:14380:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2bdf781 reply state 0000000062b66c8f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fde2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548895.817942:0:14380:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787548895.821399:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+24:14483:x1874380416211072:12345-192.168.206.13@tcp:36:dd.0 Request processed in 3087us (3468us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787548895.821549:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 35 00000020:00080000:2.0:1787548895.823113:0:14380:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787548895.824023:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fde2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.824043:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fde2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.824052:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fde2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.824058:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2a200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:3.0:1787548895.824065:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fde2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.824074:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fde2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.824094:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:3.0:1787548895.824098:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787548895.824102:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fde2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548895.824181:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fde2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548895.875398:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787548895.949407:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548895.949563:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416211328 00000100:00100000:1.0:1787548895.949573:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416211328 00000100:00100000:1.0:1787548895.949630:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00100000:1.0:1787548895.949639:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+23:14483:x1874380416211328:12345-192.168.206.13@tcp:35:dd.0 00000100:00100000:1.0:1787548895.949916:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+24:14483:x1874380416211328:12345-192.168.206.13@tcp:35:dd.0 Request processed in 277us (524us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1787548895.949932:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 9 00000100:00100000:0.0:1787548896.253510:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548896.253624:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416211456 00000100:00100000:2.0:1787548896.253634:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416211456 00000100:00100000:2.0:1787548896.253713:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 36 00000100:00100000:2.0:1787548896.253725:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+24:14497:x1874380416211456:12345-192.168.206.13@tcp:101:stat.0 00010000:00010000:2.0:1787548896.253749:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548896.253770:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fde9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2706 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.253853:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fdf0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.253866:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fdf0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.253880:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fdf0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.253895:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fdf7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.253902:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.253927:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254208:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fdfe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254218:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fdfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254226:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fdfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548896.254264:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787548896.254270:0:14381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548896.254306:0:14381:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fdfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254479:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fdfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254491:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fdf0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254497:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fdf0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254503:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fdf0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254509:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2a600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548896.254514:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fdf0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254530:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fdf0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254543:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:2.0:1787548896.254545:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548896.254550:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fdf0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254557:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fdf0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254574:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254580:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fdf7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254586:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fdf7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254592:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2a000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548896.254595:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fdf7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254600:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fdf7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254608:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8fec87ceb700) 00010000:00010000:2.0:1787548896.254610:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548896.254613:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fdf7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254629:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fdf7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254665:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fde9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2706 expref: 26 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254680:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fdfe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2706 expref: 25 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.254687:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548896.254689:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548896.254691:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2a200, rc 0) 00000100:00100000:2.0:1787548896.254762:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+25:14497:x1874380416211456:12345-192.168.206.13@tcp:101:stat.0 Request processed in 1040us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548896.254770:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 36 00000100:00080000:0.0:1787548896.254863:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548896.263229:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787548896.263587:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431922944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548896.263672:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548896.263850:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431922944 00000100:00100000:2.0:1787548896.263866:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431922944 00000100:00080000:0.0:1787548896.263966:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787548896.264182:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787548896.264194:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431922944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787548896.264229:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548896.264279:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431922944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548896.264286:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787548896.264392:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431922944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787548896.299449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548896.299551:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416211712 00000100:00100000:2.0:1787548896.299570:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416211712 00000100:00100000:2.0:1787548896.299630:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 37 00000100:00100000:2.0:1787548896.299640:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+25:14503:x1874380416211712:12345-192.168.206.13@tcp:36:truncate.0 00010000:00010000:2.0:1787548896.299702:0:15793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548896.299728:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fdfe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2706 expref: 25 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.299748:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548896.299753:0:15793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787548896.299978:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fe05 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.299991:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fe05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.300000:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fe05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787548896.300050:0:15793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1787548896.300077:0:15793:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012321f01 reply state 0000000089f55553 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fe05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548896.300086:0:15793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787548896.300245:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+27:14503:x1874380416211712:12345-192.168.206.13@tcp:36:truncate.0 Request processed in 606us (805us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787548896.300253:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 37 00000020:00080000:2.0:1787548896.300257:0:15793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787548896.302052:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fe05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.302067:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fe05 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.302074:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fe05 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.302092:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2b200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548896.302097:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fe05 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.302105:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fe05 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.302120:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548896.302122:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548896.302126:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fe05 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.302167:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fe05 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548896.313954:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548896.313999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548896.314025:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548896.314058:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548896.314088:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416212096 00000100:00100000:0.0:1787548896.314096:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416212096 00000100:00100000:0.0:1787548896.314189:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416212352 00000100:00100000:0.0:1787548896.314193:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416212352 00000100:00100000:0.0:1787548896.314205:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416211968 00000100:00100000:0.0:1787548896.314207:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416211968 00000100:00100000:0.0:1787548896.314224:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 15 00000100:00100000:0.0:1787548896.314234:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+5:2353:x1874380416212096:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548896.314305:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+5:2353:x1874380416212096:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 73us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548896.314313:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 15 00000100:00100000:0.0:1787548896.314329:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:0.0:1787548896.314336:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2353:x1874380416212352:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548896.314361:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2353:x1874380416212352:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 25us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548896.314367:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:0.0:1787548896.314379:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 17 00000100:00100000:0.0:1787548896.314385:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+5:2353:x1874380416211968:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548896.314407:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+5:2353:x1874380416211968:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 23us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548896.314412:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 17 00000100:00080000:0.0:1787548896.314432:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787548896.314435:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787548896.314459:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548896.314516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548896.314531:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416212480 00000100:00100000:0.0:1787548896.314535:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416212480 00000100:00100000:0.0:1787548896.314561:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00100000:0.0:1787548896.314574:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2353:x1874380416212480:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548896.314598:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2353:x1874380416212480:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 25us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548896.314604:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00080000:0.0:1787548896.314620:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787548896.314700:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416212224 00000100:00100000:0.0:1787548896.314704:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416212224 00000100:00080000:0.0:1787548896.314719:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548896.314742:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 29 00000100:00100000:0.0:1787548896.314749:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+11:2353:x1874380416212224:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548896.314786:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+11:2353:x1874380416212224:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 38us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548896.314793:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 29 00000100:00100000:2.0:1787548896.315632:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416211840 00000100:00100000:2.0:1787548896.315642:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416211840 00000100:00100000:2.0:1787548896.315679:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 124 00000100:00100000:2.0:1787548896.315687:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:2353:x1874380416211840:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548896.315747:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:2353:x1874380416211840:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 60us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548896.315753:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 124 00000100:00100000:0.0:1787548896.578969:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548896.579066:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416212608 00000100:00100000:2.0:1787548896.579075:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416212608 00000100:00100000:2.0:1787548896.579127:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 38 00000100:00100000:2.0:1787548896.579161:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+26:14517:x1874380416212608:12345-192.168.206.13@tcp:101:stat.0 00010000:00010000:2.0:1787548896.579182:0:15793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548896.579348:0:15793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fe0c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a270d expref: -99 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.579706:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe13 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.579720:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe13 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.579732:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe13 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.579746:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe1a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.579753:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.579759:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.579920:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fe21 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.579928:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fe21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.579935:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fe21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548896.579966:0:15793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1787548896.579970:0:15793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787548896.579985:0:15793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fe21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580006:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fe21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580015:0:15793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe13 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580021:0:15793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe13 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580028:0:15793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe13 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580035:0:15793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2a200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548896.580039:0:15793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe13 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580046:0:15793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe13 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580058:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:2.0:1787548896.580060:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548896.580065:0:15793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe13 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580071:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe13 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580087:0:15793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580093:0:15793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe1a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580105:0:15793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580109:0:15793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2a000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548896.580112:0:15793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580118:0:15793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580125:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8fec87ceb700) 00010000:00010000:2.0:1787548896.580127:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548896.580224:0:15793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe1a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580231:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe1a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580263:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424fe0c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a270d expref: 28 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580276:0:15793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fe21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a270d expref: 27 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.580283:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548896.580284:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548896.580287:0:15793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2a600, rc 0) 00000100:00100000:2.0:1787548896.580350:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+27:14517:x1874380416212608:12345-192.168.206.13@tcp:101:stat.0 Request processed in 1190us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548896.580366:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 38 00000100:00100000:3.0:1787548896.763396:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548896.765116:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416212864 00000100:00100000:0.0:1787548896.765169:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416212864 00000100:00100000:0.0:1787548896.765239:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 39 00000100:00100000:0.0:1787548896.765250:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+27:14527:x1874380416212864:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:0.0:1787548896.765269:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548896.765287:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2714 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548896.765455:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787548896.765572:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2714 expref: 29 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.765605:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec838f6700) 00010000:00010000:0.0:1787548896.765608:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787548896.765614:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2714 expref: 29 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.765629:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150600, rc 0) 00000100:00100000:0.0:1787548896.765689:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+28:14527:x1874380416212864:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 441us (2304us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1787548896.765696:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 39 00000100:00100000:3.0:1787548896.773167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548896.773250:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416213120 00000100:00100000:1.0:1787548896.773260:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416213120 00000100:00100000:1.0:1787548896.773325:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:1.0:1787548896.773335:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb7e08850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+28:14527:x1874380416213120:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:1.0:1787548896.773582:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb7e08850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+29:14527:x1874380416213120:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 247us (458us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787548896.773590:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 10 00000100:00100000:1.0:1787548896.871636:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548896.871754:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416213376 00000100:00100000:0.0:1787548896.871763:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416213376 00000100:00100000:0.0:1787548896.871820:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 40 00000100:00100000:0.0:1787548896.871840:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+29:14533:x1874380416213376:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:0.0:1787548896.871864:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548896.871884:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe36 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a271b expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.871979:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.871993:0:14380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd72 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26dc expref: 30 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.872002:0:14380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fe21 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a270d expref: 30 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.872028:0:14380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.872060:0:14380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fe21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a270d expref: 30 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.872072:0:14380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fe21 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a270d expref: 30 pid: 15793 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548896.872086:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90096680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14380:1874380431923072:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548896.872290:0:14380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26dc expref: 30 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.872652:0:14380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd72 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26dc expref: 30 pid: 15793 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548896.872665:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14380:1874380431923200:192.168.206.13@tcp:104: 00000100:00100000:0.0:1787548896.872693:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787548896.878657:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548896.878746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548896.878856:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416213504 00000100:00100000:2.0:1787548896.878866:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416213504 00010000:00010000:2.0:1787548896.878906:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fe21 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a270d expref: 31 pid: 15793 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548896.878946:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416213632 00000100:00100000:2.0:1787548896.878949:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416213632 00010000:00010000:2.0:1787548896.878962:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd72 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26dc expref: 32 pid: 15793 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548896.878979:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:2.0:1787548896.878995:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81810450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+32:2351:x1874380416213504:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548896.879008:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548896.879016:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fe21 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a270d expref: 32 pid: 15793 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.879029:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fe21 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a270d expref: 32 pid: 15793 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.879052:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548896.879057:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.879066:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.879072:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548896.879136:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81810450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+32:2351:x1874380416213504:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 149us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548896.879172:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:2.0:1787548896.879221:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:2.0:1787548896.879228:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+31:2351:x1874380416213632:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548896.879235:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548896.879241:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd72 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26dc expref: 31 pid: 15793 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.879250:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd72 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26dc expref: 31 pid: 15793 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.879261:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548896.879264:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.879272:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.879279:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.879294:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548896.879327:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+31:2351:x1874380416213632:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 100us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548896.879333:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 12 00010000:00010000:0.0:1787548896.881665:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424fe21 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a270d expref: 30 pid: 15793 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548896.881692:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90096680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14380:1874380431923072:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548896.881706:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fd72 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a26dc expref: 29 pid: 15793 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548896.881751:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14380:1874380431923200:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548896.881779:0:14380:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.881788:0:14380:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.881794:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548896.881816:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1787548896.881995:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe36 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a271b expref: 30 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.882011:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a271b expref: 29 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.882019:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:0.0:1787548896.882022:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787548896.882025:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151e00, rc 0) 00000100:00100000:0.0:1787548896.882095:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+29:14533:x1874380416213376:12345-192.168.206.13@tcp:101:bash.0 Request processed in 10266us (10468us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1787548896.882103:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 40 00000100:00100000:3.0:1787548896.894275:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548896.894905:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416213888 00000100:00100000:0.0:1787548896.894922:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416213888 00000100:00100000:0.0:1787548896.895015:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 41 00000100:00100000:0.0:1787548896.895028:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+29:14533:x1874380416213888:12345-192.168.206.13@tcp:36:bash.0 00010000:00010000:0.0:1787548896.895486:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424fe4b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.895508:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424fe4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.895521:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424fe4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787548896.895588:0:14381:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1787548896.895619:0:14381:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021e59f72 reply state 0000000074437c27 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424fe4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548896.895630:0:14381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787548896.895771:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+32:14533:x1874380416213888:12345-192.168.206.13@tcp:36:bash.0 Request processed in 744us (1503us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1787548896.895780:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 41 00000020:00080000:0.0:1787548896.895787:0:14381:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787548896.900465:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424fe4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.900484:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424fe4b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.900502:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424fe4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.900508:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90150e00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548896.900513:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424fe4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.900520:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424fe4b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.900555:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:0.0:1787548896.900557:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548896.900562:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424fe4b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.900567:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424fe4b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548896.910275:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548896.914103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548896.923424:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416214016 00000100:00100000:2.0:1787548896.923441:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416214016 00000100:00100000:2.0:1787548896.923606:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 42 00000100:00100000:2.0:1787548896.923632:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+31:14533:x1874380416214016:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:2.0:1787548896.923655:0:15793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548896.923673:0:15793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe52 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2722 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.923731:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe52 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2722 expref: 32 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.923745:0:15793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe52 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2722 expref: 32 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.923764:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548896.923767:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787548896.923771:0:15793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2a200, rc 0) 00000100:00100000:2.0:1787548896.925616:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+32:14533:x1874380416214016:12345-192.168.206.13@tcp:101:bash.0 Request processed in 1977us (11514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548896.925627:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 42 00000100:00100000:3.0:1787548896.946246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548896.946450:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416214144 00000100:00100000:0.0:1787548896.946461:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416214144 00000100:00100000:0.0:1787548896.946523:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 43 00000100:00100000:0.0:1787548896.946533:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+32:14533:x1874380416214144:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:0.0:1787548896.946552:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548896.946573:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424fe59 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2729 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.946670:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe60 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.946686:0:14379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a271b expref: 33 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.946696:0:14379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe60 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.946726:0:14379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a271b expref: 33 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.946738:0:14379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a271b expref: 33 pid: 14380 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548896.946759:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14379:1874380431923328:192.168.206.13@tcp:104: 00000100:00100000:0.0:1787548896.946856:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787548896.953569:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14379:1874380431923328:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548896.953602:0:14379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe60 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548896.968242:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548896.968455:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416214272 00000100:00100000:2.0:1787548896.968466:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416214272 00010000:00010000:2.0:1787548896.968511:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a271b expref: 34 pid: 14380 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548896.968560:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 13 00000100:00100000:2.0:1787548896.968571:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+34:2351:x1874380416214272:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548896.968586:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548896.968593:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a271b expref: 34 pid: 14380 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.968626:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a271b expref: 34 pid: 14380 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.968648:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151e00/0xcb7c48919424fe3d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a271b expref: 34 pid: 14380 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.968665:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548896.968670:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe60 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.968679:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.968687:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe60 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.968707:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548896.968767:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+33:2351:x1874380416214272:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 197us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548896.968775:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 13 00010000:00010000:0.0:1787548896.968859:0:14379:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.968867:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548896.968913:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787548896.968918:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548896.968938:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.968970:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150e00/0xcb7c48919424fe59 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2729 expref: 33 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.968996:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2729 expref: 32 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548896.969004:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:0.0:1787548896.969006:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787548896.969009:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90150600, rc 0) 00000100:00100000:0.0:1787548896.969035:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+32:14533:x1874380416214144:12345-192.168.206.13@tcp:101:bash.0 Request processed in 22504us (22799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548896.969049:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 43 00000100:00100000:2.0:1787548896.978782:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548896.978928:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416214528 00000100:00100000:3.0:1787548896.978953:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416214528 00000100:00100000:3.0:1787548896.979422:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 2 00000100:00100000:3.0:1787548896.979435:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+32:14533:x1874380416214528:12345-192.168.206.13@tcp:103:bash.0 00010000:00010000:3.0:1787548896.979450:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787548896.979474:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90150600/0xcb7c48919424fe60 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2729 expref: 32 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548896.979495:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe52 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2722 expref: 31 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548896.979509:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87cebf00) 00010000:00010000:3.0:1787548896.979520:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787548896.979629:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+30:14533:x1874380416214528:12345-192.168.206.13@tcp:103:bash.0 Request processed in 196us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548896.979653:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 2 00000100:00100000:0.0:1787548896.986367:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548896.986444:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416214656 00000100:00100000:2.0:1787548896.986453:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416214656 00000100:00100000:2.0:1787548896.986512:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 44 00000100:00100000:2.0:1787548896.986522:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+30:14533:x1874380416214656:12345-192.168.206.13@tcp:58:bash.0 00010000:00010000:2.0:1787548896.986615:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fe67 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.986648:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fe67 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.986659:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fe67 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787548896.989419:0:14380:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787548896.989623:0:14380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787548896.989694:0:14380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787548896.989813:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+30:14533:x1874380416214656:12345-192.168.206.13@tcp:58:bash.0 Request processed in 3288us (3452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548896.989825:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 44 00000100:00100000:0.0:1787548896.993611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548896.994399:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416214784 00000100:00100000:2.0:1787548896.994410:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416214784 00000100:00100000:2.0:1787548896.994472:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 45 00000100:00100000:2.0:1787548896.994483:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+30:14533:x1874380416214784:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:2.0:1787548896.994504:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548896.994524:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe6e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2730 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548896.994578:0:14381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fe67 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.001963:0:14381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe6e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2730 expref: 31 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.002035:0:14381:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fe67 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.002076:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe6e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2730 expref: 31 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.002091:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:2.0:1787548897.002094:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787548897.002098:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe6e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2730 expref: 31 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.002108:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2a200, rc 0) 00000100:00100000:2.0:1787548897.002187:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+31:14533:x1874380416214784:12345-192.168.206.13@tcp:101:bash.0 Request processed in 7705us (8584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548897.002196:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 45 00000040:00080000:2.0:1787548897.475411:0:14413:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787548897.475421:0:14413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787548897.475464:0:14413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787548897.475471:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787548897.475598:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14413:1874380431923456:192.168.206.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787548897.475774:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec865f6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787548897.489266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548897.489387:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416214912 00000100:00100000:1.0:1787548897.489396:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416214912 00000100:00100000:1.0:1787548897.489446:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 0 00000100:00100000:1.0:1787548897.489456:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:555100d0-5cca-42dc-9b2b-8251df4fed16+32:14534:x1874380416214912:12345-192.168.206.13@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787548897.489541:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:555100d0-5cca-42dc-9b2b-8251df4fed16+32:14534:x1874380416214912:12345-192.168.206.13@tcp:900:lhsmtool_posix.0 Request processed in 86us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548897.489549:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 0 00000100:00100000:2.0:1787548897.489777:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14413:1874380431923456:192.168.206.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787548897.505041:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548897.505446:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416215040 00000100:00100000:2.0:1787548897.505456:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416215040 00000100:00100000:2.0:1787548897.505515:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 46 00000100:00100000:2.0:1787548897.505525:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec90094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+31:14534:x1874380416215040:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787548897.505555:0:15793:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787548897.505670:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec90094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+31:14534:x1874380416215040:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 Request processed in 147us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548897.505691:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 46 00000100:00100000:3.0:1787548897.524258:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548897.524497:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416215168 00000100:00100000:0.0:1787548897.524508:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416215168 00000100:00100000:0.0:1787548897.524568:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 47 00000100:00100000:0.0:1787548897.524578:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+31:14534:x1874380416215168:12345-192.168.206.13@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787548897.524648:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fe75 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524665:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fe75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524678:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fe75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524721:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fe7c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524729:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fe7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524737:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fe7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524762:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fe83 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524787:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fe83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524794:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fe83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548897.524845:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787548897.524850:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548897.524865:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fe83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524875:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fe75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524881:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fe75 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524888:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fe75 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524894:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548897.524898:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fe75 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524905:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fe75 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524917:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fec838f6900) 00010000:00010000:0.0:1787548897.524921:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548897.524926:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fe75 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524942:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fe75 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524956:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fe7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524962:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fe7c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524967:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fe7c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524971:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548897.524973:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fe7c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524979:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fe7c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524986:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8feca2cf6300) 00010000:00010000:0.0:1787548897.524988:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548897.524991:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fe7c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.524995:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fe7c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.525009:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fe83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.525014:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fe83 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.525025:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fe83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.525030:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548897.525033:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fe83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.525039:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fe83 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.525047:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:0.0:1787548897.525049:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548897.525052:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fe83 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.525057:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fe83 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548897.525177:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+31:14534:x1874380416215168:12345-192.168.206.13@tcp:34:lhsmtool_posix.0 Request processed in 598us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548897.525186:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 47 00000100:00100000:3.0:1787548897.534581:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548897.537360:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416215424 00000100:00100000:2.0:1787548897.537377:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416215424 00000100:00100000:2.0:1787548897.537457:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 48 00000100:00100000:2.0:1787548897.537469:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+31:14534:x1874380416215424:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787548897.537489:0:15793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548897.537511:0:15793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fe8a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2737 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.537615:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe91 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.537630:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.537642:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548897.537653:0:15793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787548897.537760:0:15793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.537767:0:15793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe91 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.537774:0:15793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.537781:0:15793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2a000 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548897.537785:0:15793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.537806:0:15793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe91 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.537819:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:2.0:1787548897.537822:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787548897.537839:0:15793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe91 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.537847:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fe91 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.537904:0:15793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fe8a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2737 expref: 33 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.537915:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fec838f6900) 00010000:00010000:2.0:1787548897.537917:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787548897.537921:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fe8a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2737 expref: 33 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.537932:0:15793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2ae00, rc 0) 00000100:00100000:2.0:1787548897.538115:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+32:14534:x1874380416215424:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 647us (3548us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1787548897.538122:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 48 00000100:00100000:1.0:1787548897.541792:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548897.541884:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416215552 00000100:00100000:0.0:1787548897.541895:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416215552 00000100:00100000:0.0:1787548897.541969:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 49 00000100:00100000:0.0:1787548897.541979:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecad561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+32:14534:x1874380416215552:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787548897.542033:0:14379:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787548897.542159:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecad561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+32:14534:x1874380416215552:12345-192.168.206.13@tcp:53:lhsmtool_posix.0 Request processed in 181us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548897.542176:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 49 00000100:00100000:3.0:1787548897.550727:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548897.550883:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416215808 00000100:00100000:2.0:1787548897.550893:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416215808 00000100:00100000:2.0:1787548897.550959:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 50 00000100:00100000:2.0:1787548897.550970:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+32:14534:x1874380416215808:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787548897.551006:0:15793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548897.551026:0:15793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fe9f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a273e expref: -99 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787548897.551683:0:15793:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1787548897.551691:0:15793:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787548897.551750:0:15793:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787548897.552030:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fea6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.552045:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fea6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.552057:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fea6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.552119:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fe9f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a273e expref: 35 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.552172:0:15793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fea6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a273e expref: 34 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.552182:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:2.0:1787548897.552185:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787548897.552189:0:15793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2a000, rc 0) 00000100:00100000:2.0:1787548897.552255:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+34:14534:x1874380416215808:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 1287us (1545us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787548897.552263:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 50 00000100:00100000:3.0:1787548897.561534:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548897.561866:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416216064 00000100:00100000:0.0:1787548897.561877:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416216064 00000100:00100000:0.0:1787548897.561934:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 51 00000100:00100000:0.0:1787548897.561946:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+34:14534:x1874380416216064:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787548897.562001:0:14379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548897.562026:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a000/0xcb7c48919424fea6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a273e expref: 34 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562048:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:0.0:1787548897.562059:0:14379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787548897.562079:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424feb4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562091:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424feb4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562101:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424feb4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562186:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424febb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd71e6fe4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562194:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424febb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd71e6fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562200:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424febb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd71e6fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562454:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424feb4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562463:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424feb4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562480:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424feb4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562487:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548897.562492:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424feb4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562500:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424feb4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562509:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:0.0:1787548897.562512:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548897.562516:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424feb4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562521:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424feb4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562532:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424febb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd71e6fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562537:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424febb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd71e6fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562542:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424febb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd71e6fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562555:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548897.562558:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424febb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd71e6fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562564:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424febb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd71e6fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562571:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd71e6fe4 (ffff8feca2cf6300) 00010000:00010000:0.0:1787548897.562574:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548897.562576:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424febb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd71e6fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.562582:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424febb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd71e6fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548897.562714:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+33:14534:x1874380416216064:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 770us (1188us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787548897.562722:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 51 00000100:00100000:1.0:1787548897.573019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548897.586990:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416216192 00000100:00100000:2.0:1787548897.587022:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416216192 00000100:00100000:2.0:1787548897.587102:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 52 00000100:00100000:2.0:1787548897.587122:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+33:14534:x1874380416216192:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787548897.587156:0:15793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548897.587180:0:15793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fec2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2745 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.587217:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fec9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.587242:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fec9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.587254:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fec9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.587355:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fec2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2745 expref: 35 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.587376:0:15793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a400/0xcb7c48919424fec9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2745 expref: 34 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.587385:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:2.0:1787548897.587388:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787548897.587391:0:15793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2a400, rc 0) 00000100:00100000:2.0:1787548897.587458:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+34:14534:x1874380416216192:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 348us (14449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548897.587466:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 52 00000100:00100000:3.0:1787548897.596275:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548897.596687:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416216448 00000100:00100000:2.0:1787548897.596712:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416216448 00000100:00100000:2.0:1787548897.596776:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 53 00000100:00100000:2.0:1787548897.596787:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+34:14534:x1874380416216448:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787548897.596894:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fed0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.596911:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fed0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.596922:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fed0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787548897.599679:0:14381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1787548897.599696:0:14381:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 520476565622ns, next at 521476562227ns, rc = 0 00000004:00010000:3.0:1787548897.599833:0:14381:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b610b7b reply state 000000007330516c transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fed0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548897.599845:0:14381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787548897.600026:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+36:14534:x1874380416216448:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 3237us (3766us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1787548897.600035:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 53 00000100:00100000:3.0:1787548897.606328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548897.606600:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416216576 00000100:00100000:0.0:1787548897.606610:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416216576 00000100:00100000:0.0:1787548897.606668:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 54 00000100:00100000:0.0:1787548897.606678:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+36:14534:x1874380416216576:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787548897.606703:0:15793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548897.606723:0:15793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fed7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a274c expref: -99 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.606790:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fed7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a274c expref: 37 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.606818:0:15793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fed7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a274c expref: 37 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.606853:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:0.0:1787548897.606856:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787548897.606859:0:15793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151200, rc 0) 00000100:00100000:0.0:1787548897.606915:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+37:14534:x1874380416216576:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 238us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548897.606922:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 54 00010000:00010000:2.0:1787548897.607260:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fed0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.607269:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fed0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.607276:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fed0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.607281:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2ae00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548897.607285:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fed0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.607292:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fed0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.607305:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:2.0:1787548897.607308:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787548897.607311:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fed0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.607330:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2ae00/0xcb7c48919424fed0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548897.610817:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548897.611251:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416216704 00000100:00100000:0.0:1787548897.611261:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416216704 00000100:00100000:0.0:1787548897.611322:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 13 00000100:00100000:0.0:1787548897.611332:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+5:2352:x1874380416216704:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787548897.611662:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+6:2352:x1874380416216704:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 Request processed in 330us (852us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787548897.611670:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 13 00000100:00100000:3.0:1787548897.615123:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548897.615303:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416216960 00000100:00100000:1.0:1787548897.615312:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416216960 00000100:00100000:1.0:1787548897.615368:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:1.0:1787548897.615378:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+36:14534:x1874380416216960:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787548897.615587:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+37:14534:x1874380416216960:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 Request processed in 210us (473us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1787548897.615595:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 11 00000100:00100000:3.0:1787548897.624096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548897.624229:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416217216 00000100:00100000:0.0:1787548897.624239:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416217216 00000100:00100000:0.0:1787548897.624299:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 55 00000100:00100000:0.0:1787548897.624310:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+37:14534:x1874380416217216:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787548897.624416:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+37:14534:x1874380416217216:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 107us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548897.624424:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 55 00000100:00100000:3.0:1787548897.630775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548897.630946:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416217344 00000100:00100000:0.0:1787548897.630968:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416217344 00000100:00100000:0.0:1787548897.631043:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 56 00000100:00100000:0.0:1787548897.631054:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+37:14534:x1874380416217344:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787548897.631073:0:15793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548897.631092:0:15793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fede lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2753 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.631200:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fee5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.631214:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fee5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.631226:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fee5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787548897.631261:0:15793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787548897.631278:0:15793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fee5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.631303:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fede lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2753 expref: 39 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.631320:0:15793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fee5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2753 expref: 38 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.631329:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:0.0:1787548897.631332:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787548897.631335:0:15793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151600, rc 0) 00000100:00100000:0.0:1787548897.631397:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+38:14534:x1874380416217344:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 344us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548897.631409:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 56 00000100:00100000:1.0:1787548897.646238:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548897.646459:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416217472 00000100:00100000:3.0:1787548897.646469:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416217472 00000100:00100000:3.0:1787548897.646605:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:3.0:1787548897.646616:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+6:2351:x1874380416217472:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787548897.646633:0:15064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548897.646655:0:15064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048bc1411/0xcb7c48919424feec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a275a expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787548897.646701:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8bd4e2, blocks: 0x1 00010000:00010000:3.0:1787548897.647411:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=520s v=(0 0) 00010000:00010000:3.0:1787548897.647419:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548897.647430:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048bc1411/0xcb7c48919424feec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a275a expref: 7 pid: 15064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548897.647454:0:15064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048bc1411/0xcb7c48919424feec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a275a expref: 7 pid: 15064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548897.647468:0:15064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92800, rc 0) 00000100:00100000:0.0:1787548897.648420:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+7:2351:x1874380416217472:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 1799us (2186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548897.648430:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:3.0:1787548897.660372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548897.661108:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416217728 00000100:00100000:0.0:1787548897.661119:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416217728 00000100:00100000:0.0:1787548897.661223:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 57 00000100:00100000:0.0:1787548897.661234:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+38:14534:x1874380416217728:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787548897.661345:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+38:14534:x1874380416217728:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 113us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548897.661353:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 57 00000100:00100000:1.0:1787548897.685449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548897.685554:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416217856 00000100:00100000:0.0:1787548897.685563:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416217856 00000100:00100000:0.0:1787548897.685623:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 58 00000100:00100000:0.0:1787548897.685633:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+38:14534:x1874380416217856:12345-192.168.206.13@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787548897.744773:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000001:00080000:1.0:1787548897.744802:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1787548897.744812:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:1.0:1787548897.744843:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787548897.744895:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1787548897.745100:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787548897.745150:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431923584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787548897.745218:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787548897.745291:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431923584 00000100:00100000:3.0:1787548897.745298:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431923584 00000100:00100000:3.0:1787548897.745354:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787548897.745365:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874380431923584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787548897.745530:0:15065:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787548897.745534:0:15065:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787548897.745536:0:15065:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787548897.745538:0:15065:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787548898 -> 1787548898 00002000:00010000:3.0:1787548897.745540:0:15065:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787548897.745582:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874380431923584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 219us (362us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787548897.745608:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787548897.745630:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787548897.745665:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fecb3dbe680/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787548897.745672:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874380431923584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787548897.746401:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+13:14534:x1874380416217856:12345-192.168.206.13@tcp:44:lhsmtool_posix.0 Request processed in 60765us (60956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548897.746414:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 58 00000100:00100000:1.0:1787548897.760893:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548897.761153:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416217984 00000100:00100000:0.0:1787548897.761163:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416217984 00000100:00100000:0.0:1787548897.761226:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:0.0:1787548897.761236:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+7:2351:x1874380416217984:12345-192.168.206.13@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787548897.761347:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+7:2351:x1874380416217984:12345-192.168.206.13@tcp:16:lhsmtool_posix.0 Request processed in 111us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548897.761355:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:3.0:1787548897.776671:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548897.776790:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416218240 00000100:00100000:0.0:1787548897.776800:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416218240 00000100:00100000:0.0:1787548897.776881:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 59 00000100:00100000:0.0:1787548897.776891:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+13:14534:x1874380416218240:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787548897.776942:0:14379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787548897.776966:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151600/0xcb7c48919424fee5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2753 expref: 13 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.776987:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:0.0:1787548897.776992:0:14379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787548897.777188:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fef3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.777201:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fef3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.777211:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fef3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787548897.777442:0:14379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e902675 reply state 0000000039464c11 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fef3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548897.777452:0:14379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787548897.777551:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+14:14534:x1874380416218240:12345-192.168.206.13@tcp:36:lhsmtool_posix.0 Request processed in 661us (890us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1787548897.777558:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 59 00000100:00100000:1.0:1787548897.779904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548897.780215:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416218368 00000100:00100000:3.0:1787548897.780225:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416218368 00000100:00100000:3.0:1787548897.780335:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 17 00000100:00100000:3.0:1787548897.780346:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+7:14534:x1874380416218368:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787548897.780364:0:15065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787548897.780382:0:15065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053ba75e3/0xcb7c48919424fefa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2761 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548897.780413:0:15065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048bc1411/0xcb7c48919424feec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a275a expref: 8 pid: 15064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548897.780421:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548897.780424:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787548897.780429:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053ba75e3/0xcb7c48919424fefa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2761 expref: 8 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548897.780462:0:15065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048bc1411/0xcb7c48919424feec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a275a expref: 8 pid: 15064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787548897.780475:0:15065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048bc1411/0xcb7c48919424feec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a275a expref: 8 pid: 15064 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548897.780500:0:15065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb3dbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15065:1874380431923712:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548897.780603:0:15065:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecacd35300 going to sleep for 11 seconds 00010000:00010000:0.0:1787548897.781272:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fef3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.781283:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fef3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.781303:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fef3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.781308:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fec90151c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:0.0:1787548897.781313:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fef3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.781321:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fef3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.781335:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:0.0:1787548897.781338:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787548897.781341:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fef3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.781347:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151c00/0xcb7c48919424fef3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787548897.788479:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548897.788531:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416218496 00000100:00100000:1.0:1787548897.788541:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416218496 00000100:00100000:0.0:1787548897.788570:0:15065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb3dbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15065:1874380431923712:192.168.206.13@tcp:104: 00010000:00010000:1.0:1787548897.788576:0:14365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048bc1411/0xcb7c48919424feec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a275a expref: 9 pid: 15064 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.788597:0:15065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053ba75e3/0xcb7c48919424fefa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2761 expref: 9 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.788613:0:15065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fecbcc92000, rc 0) 00000100:00100000:1.0:1787548897.788617:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:1.0:1787548897.788625:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+9:2352:x1874380416218496:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548897.788637:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548897.788658:0:14365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048bc1411/0xcb7c48919424feec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a275a expref: 9 pid: 15064 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548897.788663:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+9:14534:x1874380416218368:12345-192.168.206.13@tcp:101:lhsmtool_posix.0 Request processed in 8320us (8768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548897.788670:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 17 00010000:00010000:1.0:1787548897.788671:0:14365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048bc1411/0xcb7c48919424feec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a275a expref: 9 pid: 15064 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.788691:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048bc1411/0xcb7c48919424feec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a275a expref: 8 pid: 15064 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.788704:0:14365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548897.788709:0:14365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787548897.788715:0:14365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053ba75e3/0xcb7c48919424fefa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2761 expref: 7 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.788725:0:14365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053ba75e3/0xcb7c48919424fefa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2761 expref: 7 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.788758:0:14365:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000053ba75e3/0xcb7c48919424fefa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2761 expref: 7 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548897.788783:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8feb81a87b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14365:1874380431923840:192.168.206.13@tcp:105: 00000100:00100000:1.0:1787548897.788841:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85c64840 going to sleep for 11 seconds 00000100:00100000:3.0:1787548897.795474:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431924224:0@lo:400:kworker.0 00000100:00100000:0.0:1787548897.795477:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431924096:0@lo:400:kworker.0 00000100:00100000:1.0:1787548897.795556:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431923968:0@lo:400:kworker.0 00000100:00100000:0.0:1787548897.796073:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548897.796164:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431924096 00000100:00100000:0.0:1787548897.796173:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431924096 00000100:00100000:0.0:1787548897.796219:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787548897.796228:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431924096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787548897.796297:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874380431924096:12345-0@lo:400:kworker.0 Request processed in 70us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548897.796305:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787548897.796346:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431924096:0@lo:400:kworker.0 00000100:00100000:0.0:1787548897.799296:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec90096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431924352:0@lo:400:kworker.0 00000100:00100000:0.0:1787548897.799369:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548897.799683:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431924608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787548897.799714:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548897.800222:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431924608 00000100:00100000:2.0:1787548897.800230:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431924608 00000100:00100000:3.0:1787548897.800247:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548897.800274:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787548897.800284:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874380431924608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787548897.800319:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548897.800379:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874380431924608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548897.800386:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787548897.800427:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431924352 00000100:00100000:2.0:1787548897.800432:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431924352 00000100:00100000:2.0:1787548897.800459:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431924224 00000100:00100000:2.0:1787548897.800462:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431924224 00000100:00100000:2.0:1787548897.800484:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787548897.800502:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431924352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548897.800553:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874380431924352:12345-0@lo:400:kworker.0 Request processed in 63us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548897.800564:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787548897.800578:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787548897.800584:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb3dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431924224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548897.800614:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874380431924224:12345-0@lo:400:kworker.0 Request processed in 31us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548897.800633:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787548897.800669:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874380431924352:0@lo:400:kworker.0 00000100:00100000:2.0:1787548897.800910:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8feb81a87b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14365:1874380431923840:192.168.206.13@tcp:105: 00010000:00010000:2.0:1787548897.800926:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548897.800990:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb3dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+7:2352:x1874380416218496:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 12365us (12520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548897.801000:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:1.0:1787548897.801798:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548897.801885:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431924480:0@lo:400:kworker.0 00000100:00100000:1.0:1787548897.801915:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548897.802049:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431924480 00000100:00100000:2.0:1787548897.802056:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431924480 00000100:00100000:2.0:1787548897.802107:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787548897.802116:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feb81a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431924480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787548897.802188:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feb81a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874380431924480:12345-0@lo:400:kworker.0 Request processed in 73us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548897.802195:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787548897.802363:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874380431924480:0@lo:400:kworker.0 00000100:00100000:0.0:1787548897.802480:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431923968 00000100:00100000:0.0:1787548897.802485:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431923968 00000100:00100000:1.0:1787548897.802694:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787548897.802702:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:3315:x1874380431923968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787548897.802742:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c+19:3315:x1874380431923968:12345-0@lo:400:kworker.0 Request processed in 41us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548897.802748:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1787548897.802763:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548897.802796:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874380431924608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787548897.802837:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874380431924224:0@lo:400:kworker.0 00000100:00100000:0.0:1787548897.802841:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548897.802889:0:16020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416218624 00000100:00100000:2.0:1787548897.802894:0:16020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416218624 00000100:00100000:2.0:1787548897.803060:0:16020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00100000:2.0:1787548897.803069:0:16020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+7:2351:x1874380416218624:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787548897.803359:0:16020:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787548897.803363:0:16020:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787548897 00002000:00010000:2.0:1787548897.803366:0:16020:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787548895 00002000:00010000:2.0:1787548897.803368:0:16020:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787548898 -> 1787548897 00002000:00010000:2.0:1787548897.803371:0:16020:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787548897.803420:0:16020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+8:2351:x1874380416218624:12345-192.168.206.13@tcp:2:lhsmtool_posix.0 Request processed in 351us (579us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787548897.803442:0:16020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 18 00000100:00100000:1.0:1787548897.803733:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec90095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50dfd5b8-4972-4dc2-a92d-95c9c6a0a20c:3315:1874380431923968:0@lo:400:kworker.0 00000100:00100000:0.0:1787548897.809686:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548897.809880:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416218752 00000100:00100000:2.0:1787548897.809891:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416218752 00000100:00100000:2.0:1787548897.809962:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 19 00000100:00100000:2.0:1787548897.809972:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+8:2352:x1874380416218752:12345-192.168.206.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787548897.810016:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f1ada40a/0xcb7c48919424ff01 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.810037:0:15066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053ba75e3/0xcb7c48919424fefa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2761 expref: 8 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.810046:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787548897.810050:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787548897.810054:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ada40a/0xcb7c48919424ff01 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.810087:0:15066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053ba75e3/0xcb7c48919424fefa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2761 expref: 8 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.810101:0:15066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053ba75e3/0xcb7c48919424fefa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2761 expref: 8 pid: 15065 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548897.810115:0:15066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecbd0cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15066:1874380431924736:192.168.206.13@tcp:104: 00000100:00100000:3.0:1787548897.811051:0:15066:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fecb50de900 going to sleep for 11 seconds 00000100:00100000:3.0:1787548897.826390:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548897.826440:0:15066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecbd0cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15066:1874380431924736:192.168.206.13@tcp:104: 00010000:00010000:0.0:1787548897.826467:0:15066:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1ada40a/0xcb7c48919424ff01 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548897.826594:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416218880 00000100:00100000:2.0:1787548897.826601:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416218880 00010000:00010000:2.0:1787548897.826651:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053ba75e3/0xcb7c48919424fefa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2761 expref: 9 pid: 15065 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548897.826740:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 15 00000100:00100000:2.0:1787548897.826750:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+9:2351:x1874380416218880:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787548897.826766:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787548897.826790:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053ba75e3/0xcb7c48919424fefa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2761 expref: 9 pid: 15065 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.826803:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053ba75e3/0xcb7c48919424fefa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2761 expref: 9 pid: 15065 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.826835:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053ba75e3/0xcb7c48919424fefa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2761 expref: 9 pid: 15065 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.826853:0:14364:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787548897.826857:0:14364:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787548897.826863:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1ada40a/0xcb7c48919424ff01 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.826872:0:14364:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ada40a/0xcb7c48919424ff01 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.826906:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787548897.826961:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+8:2351:x1874380416218880:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 212us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548897.826989:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 15 00010000:00010000:0.0:1787548897.827048:0:15066:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1ada40a/0xcb7c48919424ff01 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.827057:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1ada40a/0xcb7c48919424ff01 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.827089:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f1ada40a/0xcb7c48919424ff01 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.827098:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ada40a/0xcb7c48919424ff01 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.827106:0:15066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1ada40a/0xcb7c48919424ff01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.827113:0:15066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2ae00 already unused, calling callback (ffffffffc1679230) 00010000:00010000:0.0:1787548897.827116:0:15066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ada40a/0xcb7c48919424ff01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.827169:0:15066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ada40a/0xcb7c48919424ff01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.827183:0:15066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1ada40a/0xcb7c48919424ff01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.827190:0:15066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1ada40a/0xcb7c48919424ff01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787548897.827260:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:555100d0-5cca-42dc-9b2b-8251df4fed16+7:2352:x1874380416218752:12345-192.168.206.13@tcp:1:lhsmtool_posix.0 Request processed in 17289us (17581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548897.827278:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 19 00000100:00100000:2.0:1787548897.842195:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548897.842316:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416219136 00000100:00100000:1.0:1787548897.842325:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416219136 00000100:00100000:1.0:1787548897.842410:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 60 00000100:00100000:1.0:1787548897.842426:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+13:14534:x1874380416219136:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787548897.842526:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424ff08 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.842543:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424ff08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.842573:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424ff08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.842839:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.842851:0:14380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fed7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a274c expref: 14 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.842868:0:14380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.842903:0:14380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fed7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a274c expref: 14 pid: 15793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.842917:0:14380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fed7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a274c expref: 14 pid: 15793 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548897.842932:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14380:1874380431924864:192.168.206.13@tcp:104: 00000100:00100000:1.0:1787548897.843185:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec85c64d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787548897.850706:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14380:1874380431924864:192.168.206.13@tcp:104: 00010000:00010000:3.0:1787548897.850752:0:14380:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548897.855715:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548897.856704:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416219264 00000100:00100000:1.0:1787548897.856716:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416219264 00010000:00010000:1.0:1787548897.856761:0:14365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fed7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a274c expref: 15 pid: 15793 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548897.856806:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 16 00000100:00100000:1.0:1787548897.856816:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbd0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+15:2351:x1874380416219264:12345-192.168.206.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787548897.856861:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787548897.856869:0:14365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fed7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a274c expref: 15 pid: 15793 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.856882:0:14365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fed7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a274c expref: 15 pid: 15793 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.856904:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fec90151200/0xcb7c48919424fed7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a274c expref: 15 pid: 15793 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.856920:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:1.0:1787548897.856926:0:14365:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.856935:0:14365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.856942:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.856986:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787548897.857046:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+14:2351:x1874380416219264:12345-192.168.206.13@tcp:103:ldlm_bl.0 Request processed in 231us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548897.857054:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 16 00010000:00010000:0.0:1787548897.857122:0:14380:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.857153:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787548897.857345:0:14380:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1787548897.857506:0:14380:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1787548897.857555:0:14380:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1787548897.857630:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8370c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14380:1874380431924992:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787548897.857706:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787548897.857730:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787548897.858183:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431924992 00000100:00100000:1.0:1787548897.858191:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431924992 00000100:00100000:1.0:1787548897.858227:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548897.858246:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14380:x1874380431924992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787548897.858326:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14380:x1874380431924992:12345-0@lo:1000:mdt00_001.0 Request processed in 90us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548897.858344:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787548897.858389:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8370c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14380:1874380431924992:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787548897.859070:0:14380:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1787548897.859175:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14380:1874380431925120:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787548897.859306:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787548897.859327:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548897.859343:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431925120 00000100:00100000:1.0:1787548897.859347:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431925120 00000100:00100000:1.0:1787548897.859375:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548897.859382:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecb51f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14380:x1874380431925120:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787548897.859524:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecb51f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14380:x1874380431925120:12345-0@lo:1000:mdt00_001.0 Request processed in 142us (217us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787548897.859531:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787548897.859564:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fecb51f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14380:1874380431925120:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787548897.859591:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859599:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859606:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859612:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82135600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548897.859616:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859623:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859651:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:1.0:1787548897.859653:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787548897.859657:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859663:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff0f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859689:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fe67 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859695:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fe67 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859700:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fe67 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859705:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2b400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548897.859708:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fe67 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859714:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fe67 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859721:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:1.0:1787548897.859724:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787548897.859730:0:14380:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe6e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2730 expref: 17 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859742:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe6e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2730 expref: 17 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859756:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2730 expref: 17 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.859807:0:14380:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a200/0xcb7c48919424fe6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2730 expref: 17 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548897.859818:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec88299500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14380:1874380431925248:192.168.206.13@tcp:105: 00000100:00100000:1.0:1787548897.859885:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fec86bb80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787548897.867583:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec88299500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14380:1874380431925248:192.168.206.13@tcp:105: 00010000:00010000:1.0:1787548897.867618:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fe67 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867629:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424fe67 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867663:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424ff16 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867677:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424ff16 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867688:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424ff16 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867699:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424ff16 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867705:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424ff16 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867725:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424ff16 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867730:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82134c00 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548897.867734:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424ff16 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867741:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424ff16 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867752:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:1.0:1787548897.867755:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787548897.867758:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424ff16 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867763:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134c00/0xcb7c48919424ff16 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867771:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424ff08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867777:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424ff08 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867781:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424ff08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867785:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82134800 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:1.0:1787548897.867788:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424ff08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867803:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424ff08 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867812:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:1.0:1787548897.867815:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787548897.867818:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424ff08 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.867837:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82134800/0xcb7c48919424ff08 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787548897.868079:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbd0cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+17:14534:x1874380416219136:12345-192.168.206.13@tcp:57:lhsmtool_posix.0 Request processed in 25658us (26147us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1787548897.868089:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 60 00000020:00080000:1.0:1787548897.868095:0:14380:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787548897.868286:0:14413:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787548897.868291:0:14413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787548897.868370:0:14413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787548897.868378:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787548897.872912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548897.874002:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416219392 00000100:00100000:0.0:1787548897.874015:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416219392 00000100:00100000:0.0:1787548897.874080:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:0.0:1787548897.874090:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec88299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+17:14533:x1874380416219392:12345-192.168.206.13@tcp:49:bash.0 00000100:00100000:0.0:1787548897.874246:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec88299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+17:14533:x1874380416219392:12345-192.168.206.13@tcp:49:bash.0 Request processed in 157us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548897.874253:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 12 00000100:00100000:3.0:1787548897.875030:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548897.875119:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416219648 00000100:00100000:1.0:1787548897.875125:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416219648 00000100:00100000:1.0:1787548897.875201:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 13 00000100:00100000:1.0:1787548897.875209:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+17:14534:x1874380416219648:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787548897.876084:0:14382:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787548897.876227:0:14382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1787548897.876277:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff1d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.876294:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.876305:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.876321:0:14382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff1d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.876328:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff1d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.876335:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff1d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787548897.876349:0:14382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787548897.876464:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+19:14534:x1874380416219648:12345-192.168.206.13@tcp:35:lhsmtool_posix.0 Request processed in 1252us (1436us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1787548897.876473:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 13 00000020:00080000:1.0:1787548897.876478:0:14382:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787548897.876688:0:14368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787548897.876696:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff1d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.876703:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb82135600 already unused, calling callback (ffffffffc1679230) 00010000:00010000:2.0:1787548897.876708:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff1d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.876726:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff1d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.876740:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fec87ceba00) 00010000:00010000:2.0:1787548897.876742:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787548897.876751:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff1d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.876756:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb82135600/0xcb7c48919424ff1d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548897.876769:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548897.876771:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787548897.876772:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548897.879884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548897.879978:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416219776 00000100:00100000:0.0:1787548897.879989:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416219776 00000100:00100000:0.0:1787548897.880050:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00100000:0.0:1787548897.880059:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+7:14533:x1874380416219776:12345-192.168.206.13@tcp:101:bash.0 00010000:00010000:0.0:1787548897.880076:0:15065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787548897.880099:0:15065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da48eaeb/0xcb7c48919424ff24 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a2768 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787548897.880184:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8bd4e1, atime: 0x6a8bd4df, ctime: 0x6a8bd4e1, blocks: 0x1 00010000:00010000:0.0:1787548897.880210:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=520s v=(0 0) 00010000:00010000:0.0:1787548897.880214:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787548897.880226:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da48eaeb/0xcb7c48919424ff24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2768 expref: 8 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.880243:0:15065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da48eaeb/0xcb7c48919424ff24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a2768 expref: 8 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787548897.880257:0:15065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fec90151e00, rc 0) 00000100:00100000:0.0:1787548897.880319:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+8:14533:x1874380416219776:12345-192.168.206.13@tcp:101:bash.0 Request processed in 260us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548897.880327:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00100000:3.0:1787548897.893351:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548897.893510:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416220032 00000100:00100000:2.0:1787548897.893524:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416220032 00000100:00100000:2.0:1787548897.893598:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 14 00000100:00100000:2.0:1787548897.893625:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+19:14533:x1874380416220032:12345-192.168.206.13@tcp:35:bash.0 00000001:00080000:2.0:1787548897.893927:0:14383:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1787548897.899781:0:14383:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1787548897.900105:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+22:14533:x1874380416220032:12345-192.168.206.13@tcp:35:bash.0 Request processed in 6475us (6759us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1787548897.900118:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 14 00000020:00080000:0.0:1787548897.900124:0:14383:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787548897.923299:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787548898.058818:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548898.059011:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416220288 00000100:00100000:2.0:1787548898.059022:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416220288 00000100:00100000:2.0:1787548898.059099:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 61 00000100:00100000:2.0:1787548898.059109:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8829b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+22:14544:x1874380416220288:12345-192.168.206.13@tcp:101:lfs.0 00010000:00010000:2.0:1787548898.059153:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787548898.059175:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424ff2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3cec5d10684a276f expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787548898.059421:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787548898.059602:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424ff2b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a276f expref: 24 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.059616:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fec838f6700) 00010000:00010000:2.0:1787548898.059618:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787548898.059623:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424ff2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.13@tcp remote: 0x3cec5d10684a276f expref: 24 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.059638:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8feb81e2b200, rc 0) 00000100:00100000:2.0:1787548898.059711:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8829b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+23:14544:x1874380416220288:12345-192.168.206.13@tcp:101:lfs.0 Request processed in 603us (904us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1787548898.059719:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 61 00000100:00080000:3.0:1787548898.059867:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787548898.065608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548898.065786:0:15793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416220416 00000100:00100000:2.0:1787548898.065797:0:15793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416220416 00000100:00100000:2.0:1787548898.066353:0:15793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 62 00000100:00100000:2.0:1787548898.066367:0:15793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+23:14544:x1874380416220416:12345-192.168.206.13@tcp:34:lfs.0 00010000:00010000:2.0:1787548898.066472:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424ff39 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.066489:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424ff39 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.066501:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424ff39 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.066517:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424ff40 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.066524:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424ff40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.066530:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424ff40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.066849:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424ff47 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.066868:0:15793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424ff47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.066876:0:15793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424ff47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787548898.066915:0:15793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424ff47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.066927:0:15793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424ff39 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.066943:0:15793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424ff39 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.066950:0:15793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424ff39 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.066956:0:15793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2b200 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548898.066960:0:15793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424ff39 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.066967:0:15793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424ff39 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067288:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8feca2cf6200) 00010000:00010000:2.0:1787548898.067293:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548898.067298:0:15793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424ff39 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067304:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b200/0xcb7c48919424ff39 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067319:0:15793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424ff40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067324:0:15793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424ff40 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067329:0:15793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424ff40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067334:0:15793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2b400 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548898.067343:0:15793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424ff40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067349:0:15793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424ff40 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067356:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8fec87cebf00) 00010000:00010000:2.0:1787548898.067358:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548898.067361:0:15793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424ff40 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067366:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2b400/0xcb7c48919424ff40 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067380:0:15793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424ff47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067385:0:15793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424ff47 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067391:0:15793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424ff47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067395:0:15793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8feb81e2a600 already unused, calling callback (ffffffffc20b84f0) 00010000:00010000:2.0:1787548898.067397:0:15793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424ff47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067402:0:15793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424ff47 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067409:0:15793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fec87ceb700) 00010000:00010000:2.0:1787548898.067411:0:15793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787548898.067613:0:15793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424ff47 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787548898.067620:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8feb81e2a600/0xcb7c48919424ff47 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787548898.067722:0:15793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:555100d0-5cca-42dc-9b2b-8251df4fed16+23:14544:x1874380416220416:12345-192.168.206.13@tcp:34:lfs.0 Request processed in 1357us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548898.067922:0:15793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 62 00000100:00100000:0.0:1787548898.070625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548898.070845:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416220672 00000100:00100000:3.0:1787548898.070862:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416220672 00000100:00100000:3.0:1787548898.070918:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 15 00000100:00100000:3.0:1787548898.070929:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8370dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+23:14544:x1874380416220672:12345-192.168.206.13@tcp:35:lfs.0 00000100:00100000:3.0:1787548898.071411:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8370dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+24:14544:x1874380416220672:12345-192.168.206.13@tcp:35:lfs.0 Request processed in 480us (790us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1787548898.071427:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 15 00000001:00080000:2.0:1787548898.379514:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:2.0:1787548898.379537:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:2.0:1787548898.379543:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000040:00080000:3.0:1787548898.883607:0:14413:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787548898.883616:0:14413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787548898.883648:0:14413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787548898.883655:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787548898.952440:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787548899.906328:0:16643:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1787548899.975492:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787548900.922877:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548900.922960:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:1.0:1787548900.924347:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416220800 00000100:00100000:1.0:1787548900.924365:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416220800 00002000:00100000:1.0:1787548900.924438:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff8feca71d8e00 x1874380416220800/t0(0) o4->555100d0-5cca-42dc-9b2b-8251df4fed16@192.168.206.13@tcp:341/0 lens 504/0 e 0 to 0 dl 1787548911 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787548900.924450:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8feca71d8e00 with x1874380416220800 ext(0->8) 00002000:00010000:1.0:1787548900.924462:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8feca71d8e00 00000100:00100000:1.0:1787548900.924500:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 0 00000100:00100000:1.0:1787548900.924512:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+6:2352:x1874380416220800:12345-192.168.206.13@tcp:4:bash.0 00000100:00100000:1.0:1787548900.925038:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+8:2352:x1874380416220800:12345-192.168.206.13@tcp:4:bash.0 Request processed in 528us (2172us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787548900.925047:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 0 00002000:00100000:1.0:1787548900.925062:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff8feca71d8e00 x1874380416220800/t8589934598(0) o4->555100d0-5cca-42dc-9b2b-8251df4fed16@192.168.206.13@tcp:341/0 lens 504/448 e 0 to 0 dl 1787548911 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787548900.925069:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8feca71d8e00 with x1874380416220800 ext(0->8) 00002000:00010000:1.0:1787548900.925073:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8feca71d8e00 00000100:00080000:3.0:1787548900.926432:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787548900.928123:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416220928 00000100:00100000:0.0:1787548900.928153:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416220928 00000100:00100000:0.0:1787548900.928245:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 21 00000100:00100000:0.0:1787548900.928257:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+8:2352:x1874380416220928:12345-192.168.206.13@tcp:16:kworker.0 00010000:00010000:2.0:1787548901.001336:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787548901.036340:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:2.0:1787548901.036769:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+6:2352:x1874380416220928:12345-192.168.206.13@tcp:16:kworker.0 Request processed in 108508us (113802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548901.036781:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 21 00000100:00100000:1.0:1787548901.382701:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787548901.382722:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fec8833c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431925376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787548901.382787:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787548901.382912:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380431925376 00000100:00100000:2.0:1787548901.382921:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380431925376 00000100:00100000:2.0:1787548901.382986:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787548901.382996:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec88298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431925376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787548901.383028:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787548901.383083:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec88298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874380431925376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548901.383091:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787548901.383116:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fec8833c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874380431925376:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787548901.383173:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787548901.436597:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548901.436646:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548901.436736:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416221184 00000100:00100000:2.0:1787548901.436746:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416221184 00000100:00100000:0.0:1787548901.436754:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416221056 00000100:00100000:0.0:1787548901.436761:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416221056 00000100:00100000:0.0:1787548901.436824:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 126 00000100:00100000:2.0:1787548901.436829:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 33 00000100:00100000:0.0:1787548901.436839:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec905ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:2351:x1874380416221056:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:2.0:1787548901.436844:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8feca71d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+24:2351:x1874380416221184:12345-192.168.206.13@tcp:400:kworker.0 00000100:00080000:1.0:1787548901.436918:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787548901.436972:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec905ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3f9a8cf-27da-41c5-bc50-00f0da779636+13:2351:x1874380416221056:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 137us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548901.436979:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 126 00000100:00100000:2.0:1787548901.438607:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8feca71d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:555100d0-5cca-42dc-9b2b-8251df4fed16+24:2351:x1874380416221184:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 1761us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787548901.438620:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 33 00000100:00100000:2.0:1787548901.455199:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548901.455245:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548901.455730:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:2.0:1787548901.455760:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:3.0:1787548901.455800:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416221568 00000100:00100000:3.0:1787548901.455820:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416221568 00000100:00100000:3.0:1787548901.455882:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 34 00000100:00100000:3.0:1787548901.455892:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:2354:x1874380416221568:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:3.0:1787548901.455972:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+6:2354:x1874380416221568:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 82us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787548901.455980:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 34 00000100:00080000:3.0:1787548901.462305:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787548901.468211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.13@tcp (source: 12345-192.168.206.13@tcp) 00000100:00100000:0.0:1787548901.468308:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416221312 00000100:00100000:0.0:1787548901.468318:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416221312 00000100:00100000:0.0:1787548901.468383:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416221440 00000100:00100000:0.0:1787548901.468386:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416221440 00000100:00100000:0.0:1787548901.468397:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416221696 00000100:00100000:0.0:1787548901.468409:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416221696 00000100:00100000:0.0:1787548901.468427:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00100000:0.0:1787548901.468436:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+6:2354:x1874380416221440:12345-192.168.206.13@tcp:400:kworker.0 00000100:00100000:0.0:1787548901.468502:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+6:2354:x1874380416221440:12345-192.168.206.13@tcp:400:kworker.0 Request processed in 67us (13258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548901.468510:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 20 00000100:00100000:0.0:1787548901.468525:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 22 00000100:00100000:0.0:1787548901.468531:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fec8833c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+5:2350:x1874380416221312:12345-192.168.206.13@tcp:9:kworker.0 00000020:00000080:0.0:1787548901.468549:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424fbd5 00000100:00080000:0.0:1787548901.468564:0:15065:0:(import.c:65:import_set_state_nolock()) ffff8feb81d2c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787548901.468612:0:15065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1787548901.469087:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fec8833c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:555100d0-5cca-42dc-9b2b-8251df4fed16+2:2350:x1874380416221312:12345-192.168.206.13@tcp:9:kworker.0 Request processed in 552us (13895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548901.469095:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 22 00000100:00100000:0.0:1787548901.469110:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 23 00000100:00100000:0.0:1787548901.469117:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbcef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2350:x1874380416221696:12345-192.168.206.13@tcp:9:kworker.0 00000020:00000080:0.0:1787548901.469166:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424fc0d 00000100:00080000:0.0:1787548901.469171:0:15065:0:(import.c:65:import_set_state_nolock()) ffff8feb81d2f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787548901.469193:0:15065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1787548901.469276:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbcef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+2:2350:x1874380416221696:12345-192.168.206.13@tcp:9:kworker.0 Request processed in 159us (13514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787548901.469283:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 23 00010000:00010000:0.0:1787548901.469337:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787548901.469496:0:14368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787548901.469504:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787548901.474452:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874380416221824 00000100:00100000:1.0:1787548901.474470:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874380416221824 00000100:00100000:1.0:1787548901.474544:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.13@tcp, seq: 24 00000100:00100000:1.0:1787548901.474556:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fecbc518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+5:2350:x1874380416221824:12345-192.168.206.13@tcp:9:kworker.0 00000020:00000080:1.0:1787548901.474585:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb7c48919424fc14 00000100:00080000:1.0:1787548901.474600:0:15065:0:(import.c:65:import_set_state_nolock()) ffff8feb81d29000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787548901.474640:0:15065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:1.0:1787548901.474918:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fecbc518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb279855-398c-4aa8-baf4-2aafd9b9b5c7+2:2350:x1874380416221824:12345-192.168.206.13@tcp:9:kworker.0 Request processed in 364us (6716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787548901.474926:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.13@tcp, seq: 24 00000100:00080000:2.0:1787548901.475572:0:14375:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787548901.475629:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29457 lines, 29457 kept, 0 dropped, 0 bad.